2025-12-01 19:00:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2025-12-01 19:00:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2025-12-01 19:00:05 [astonbarclay.gb] INFO: Starting spider astonbarclay.gb
2025-12-01 19:00:05 [scrapy.addons] INFO: Enabled addons:
[]
2025-12-01 19:00:05 [asyncio] DEBUG: Using selector: EpollSelector
2025-12-01 19:00:05 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2025-12-01 19:00:05 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2025-12-01 19:00:05 [scrapy.extensions.telnet] INFO: Telnet Password: b6c68b1650a78888
2025-12-01 19:00:05 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2025-12-01 19:00:05 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/astonbarclay.gb/task_36_2025-12-01T19_00_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2025-12-01 19:00:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-01 19:00:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-01 19:00:05 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2025-12-01 19:00:05 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2025-12-01 19:00:05 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2025-12-01 19:00:05 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2025-12-01 19:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:00:05 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2025-12-01 19:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2025-12-01 19:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:05 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2025-12-01 19:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2025-12-01 19:00:05 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2025-12-01 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2025-12-01 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2025-12-01 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2025-12-01 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2025-12-01 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2025-12-01 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2025-12-01 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2025-12-01 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2025-12-01 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2025-12-01 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2025-12-01 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2025-12-01 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2025-12-01 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2025-12-01 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2025-12-01 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2025-12-01 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2025-12-01 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2025-12-01 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2025-12-01 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2025-12-01 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2025-12-01 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2025-12-01 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2025-12-01 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2025-12-01 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2025-12-01 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2025-12-01 19:00:05 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2025-12-01 19:00:05 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2025-12-01 19:00:05 [scrapy.core.engine] INFO: Spider opened
2025-12-01 19:00:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-12-01 19:00:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2025-12-01 19:00:06 [scrapy-playwright] INFO: Starting download handler
2025-12-01 19:00:06 [scrapy-playwright] INFO: Starting download handler
2025-12-01 19:00:11 [scrapy-playwright] INFO: Launching browser firefox
2025-12-01 19:00:11 [scrapy-playwright] INFO: Browser firefox launched
2025-12-01 19:00:11 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2025-12-01 19:00:12 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2025-12-01 19:00:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/vehicle-search> (resource type: document)
2025-12-01 19:00:12 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://catalogue.astonbarclay.net/vehicle-search>
2025-12-01 19:00:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/vehicle-search> (resource type: document)
2025-12-01 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/vehicle-search>
2025-12-01 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/OtAutoBlock.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/otSDKStub.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://fonts.googleapis.com/css?family=Lexend> (resource type: stylesheet, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/index-f09YzuLL.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css> (resource type: stylesheet, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/index-f09YzuLL.js>
2025-12-01 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css>
2025-12-01 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/OtAutoBlock.js>
2025-12-01 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://fonts.googleapis.com/css?family=Lexend>
2025-12-01 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/otSDKStub.js>
2025-12-01 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/018e0e2a-b608-77ca-8640-7c5f6808ddcb.json> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://sessions.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/api/profileconfig> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/MuseoSans-500-BnvKCWSl.ttf> (resource type: font, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2025-12-01 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/api/profileconfig>
2025-12-01 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/api/user> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/api/navigation> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/default-o3_sC40N.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/assets/index-f09YzuLL.js)
2025-12-01 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/default-vT_hcphp.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/assets/index-f09YzuLL.js)
2025-12-01 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/MuseoSans-500-BnvKCWSl.ttf>
2025-12-01 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/018e0e2a-b608-77ca-8640-7c5f6808ddcb.json>
2025-12-01 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://geolocation.onetrust.com/cookieconsentpub/v1/geo/location> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/api/user>
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/default-vT_hcphp.js>
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/default-o3_sC40N.js>
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/api/navigation>
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/e-xchange-icon.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/e-xchange-icon.png>
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/logo-nama.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/WV_Awards.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/logo-nama.png>
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/Business_Car_Award.jpg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/WV_Awards.png>
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/MTA_21.jpg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/Business_Car_Award.jpg>
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/logo-bsi.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/MTA_21.jpg>
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/e-xchange-icon.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/logo-bsi.png>
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/e-xchange-icon.png>
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/logo-BkQgdzqL.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/assets/logo-BkQgdzqL.svg>
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/facebook.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/facebook.png>
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/twitter.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/twitter.png>
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/sprite2.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/sprite2.png>
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/api/vehicle/all> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/logo-nama.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/logo-nama.png>
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/WV_Awards.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/WV_Awards.png>
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/Business_Car_Award.jpg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/Business_Car_Award.jpg>
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/MTA_21.jpg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/MTA_21.jpg>
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/logo-bsi.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/logo-bsi.png>
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://fonts.gstatic.com/s/lexend/v26/wlptgwvFAVdoq2_F94zlCfv0bz1WCzsWzLdneg.woff2> (resource type: font, referrer: https://fonts.googleapis.com/)
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <202 https://sessions.bugsnag.com/>
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://geolocation.onetrust.com/cookieconsentpub/v1/geo/location>
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/otBannerSdk.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/otBannerSdk.js>
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/api/vehicle/all>
2025-12-01 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/e623c1f4-7372-4084-b57d-397f3067b488/en.json> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/e623c1f4-7372-4084-b57d-397f3067b488/en.json>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otFloatingRoundedCorner.json> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/v2/otPcTab.json> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otCookieSettingsButton.json> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otCommonStyles.css> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/delivered-by-aa-logo.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/delivered-by-aa-logo.png>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-fuel.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-fuel.svg>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-transmission-auto.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-transmission-auto.svg>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-engine.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-engine.svg>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otFloatingRoundedCorner.json>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-mileage.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-mileage.svg>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-reg.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-reg.svg>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-v5.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-v5.svg>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-mot.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-vat.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-mot.svg>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-vat.svg>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/v2/otPcTab.json>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-transmission-manual-alt.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otCookieSettingsButton.json>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-transmission-manual-alt.svg>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otCommonStyles.css>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/OV22EWH/2025-11-21/image/178df415-fa58-4761-9d33-1a40f0fc545f_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/OV22EWH/2025-11-21/image/178df415-fa58-4761-9d33-1a40f0fc545f_removebg.jpg?w=600>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/OV23KVC/2025-11-24/image/bd2f04fd-e661-46b0-a6d0-7096e17c7634_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/OV23KVC/2025-11-24/image/bd2f04fd-e661-46b0-a6d0-7096e17c7634_removebg.jpg?w=600>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/CF71BWP/2025-11-24/image/3e4b3e51-b045-4b7a-a63d-386ebe5461ec_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/CF71BWP/2025-11-24/image/3e4b3e51-b045-4b7a-a63d-386ebe5461ec_removebg.jpg?w=600>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/LO25ZDR/2025-11-04/image/d919b479-8ea4-4882-ab37-0ffbe0be7271_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/LO25ZDR/2025-11-04/image/d919b479-8ea4-4882-ab37-0ffbe0be7271_removebg.jpg?w=600>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/LV25NSJ/2025-11-17/image/86e7f12a-2b9d-489c-baf1-8d54766f39c0_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/LV25NSJ/2025-11-17/image/86e7f12a-2b9d-489c-baf1-8d54766f39c0_removebg.jpg?w=600>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/3e80401d-5b30-4e28-9e7d-622daf2a4837_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/LL74ZTP/2025-10-10/image/3e80401d-5b30-4e28-9e7d-622daf2a4837_removebg.jpg?w=600>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-transmission-manual-alt.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-transmission-manual-alt.svg>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/LY73UBS/2025-11-25/image/ebb04199-2f10-4006-8340-496dad81126f_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/LY73UBS/2025-11-25/image/ebb04199-2f10-4006-8340-496dad81126f_removebg.jpg?w=600>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/OE19RKZ/2025-11-12/image/9b73275e-e800-4a69-a1d6-f19ff5811182_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/OE19RKZ/2025-11-12/image/9b73275e-e800-4a69-a1d6-f19ff5811182_removebg.jpg?w=600>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/EO25NNC/2025-10-30/image/0980b010-5490-4bc8-8ac1-d8cf281279df_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/EO25NNC/2025-10-30/image/0980b010-5490-4bc8-8ac1-d8cf281279df_removebg.jpg?w=600>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/LX24UCV/2025-11-25/image/61307134-4b62-48ff-beb2-bae27fb7b0c6_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/LX24UCV/2025-11-25/image/61307134-4b62-48ff-beb2-bae27fb7b0c6_removebg.jpg?w=600>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/EN74UEU/2025-11-06/image/b8aa37cc-25a3-4fd2-a85a-16790f021c80_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/EN74UEU/2025-11-06/image/b8aa37cc-25a3-4fd2-a85a-16790f021c80_removebg.jpg?w=600>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/LP74HZY/2025-11-12/image/09b11760-090a-4d00-8bb4-6bb65e12f41d_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/LP74HZY/2025-11-12/image/09b11760-090a-4d00-8bb4-6bb65e12f41d_removebg.jpg?w=600>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/image-unavailable.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/image-unavailable.png>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/logos/static/ot_close.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://cdn-ukwest.onetrust.com/logos/static/ot_close.svg>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/logos/aec775ee-bddc-41f9-a49c-fe4f51677786/3a1d164f-420d-4fc4-9fd6-71e7e9f1a499/e435fac8-d6c5-4147-90bb-483492b13003/logo-dark-text.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://cdn-ukwest.onetrust.com/logos/aec775ee-bddc-41f9-a49c-fe4f51677786/3a1d164f-420d-4fc4-9fd6-71e7e9f1a499/e435fac8-d6c5-4147-90bb-483492b13003/logo-dark-text.png>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/logos/static/powered_by_logo.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://cdn-ukwest.onetrust.com/logos/static/powered_by_logo.svg>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/logos/static/ot_guard_logo.svg> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://fonts.gstatic.com/s/lexend/v26/wlptgwvFAVdoq2_F94zlCfv0bz1WCzsWzLdneg.woff2>
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/pd.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/)
2025-12-01 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/logos/static/ot_guard_logo.svg>
2025-12-01 19:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/vehicle-search> (referer: None) ['playwright']
2025-12-01 19:00:18 [astonbarclay.gb] INFO: Cookies from Playwright: [{'name': 'OptanonConsent', 'value': 'isGpcEnabled=0&datestamp=Mon+Dec+01+2025+19%3A00%3A17+GMT%2B0000+(Coordinated+Universal+Time)&version=202405.1.0&browserGpcFlag=0&isIABGlobal=false&hosts=&landingPath=https%3A%2F%2Fcatalogue.astonbarclay.net%2Fvehicle-search&groups=C0001%3A1%2CC0002%3A0%2CC0004%3A0', 'domain': '.astonbarclay.net', 'path': '/', 'expires': 1796151617, 'httpOnly': False, 'secure': False, 'sameSite': 'Lax'}]
2025-12-01 19:00:18 [astonbarclay.gb] INFO: Scrapy-formatted cookies: [{'name': 'OptanonConsent', 'value': 'isGpcEnabled=0&datestamp=Mon+Dec+01+2025+19%3A00%3A17+GMT%2B0000+(Coordinated+Universal+Time)&version=202405.1.0&browserGpcFlag=0&isIABGlobal=false&hosts=&landingPath=https%3A%2F%2Fcatalogue.astonbarclay.net%2Fvehicle-search&groups=C0001%3A1%2CC0002%3A0%2CC0004%3A0', 'domain': '.astonbarclay.net', 'path': '/'}]
2025-12-01 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Adesa',RowKey='cookies') HTTP/1.1" 204 0
2025-12-01 19:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-01 19:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-01 19:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-01 19:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-01 19:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-01 19:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-01 19:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-01 19:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-01 19:00:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/pd.js>
2025-12-01 19:00:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-01 19:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/search?nonrunner=false&vehicletype=Car&agemax=9&mileagemax=320000> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117397707
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117397707%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117397707: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117426410
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117426410%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117426410: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117397685
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117397685%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117397685: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116888595
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116888595%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116888595: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117238091
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117238091%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117238091: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116258586
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116258586%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116258586: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117217494
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117217494%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117217494: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117123365
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117123365%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117123365: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116759189
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116759189%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116759189: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116643961
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116643961%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116643961: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116798984
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116798984%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116798984: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117087842
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117087842%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117087842: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117485765
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117485765%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117485765: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117183059
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117183059%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117183059: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116806926
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116806926%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116806926: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116752111
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116752111%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116752111: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117239774
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117239774%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117239774: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117537741
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117537741%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117537741: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117538127
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117538127%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117538127: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116412555
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116412555%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116412555: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117256710
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117256710%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117256710: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117024373
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024373%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117024373: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117339017
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117339017%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117339017: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117156921
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117156921%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117156921: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116996626
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116996626%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116996626: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117344303
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117344303%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117344303: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117157384
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117157384%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117157384: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117381174
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117381174%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117381174: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117366645
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117366645%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117366645: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116954790
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116954790%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116954790: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117433187
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117433187%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117433187: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117289497
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117289497%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117289497: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117363536
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117363536%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117363536: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116136757
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116136757%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116136757: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117288373
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117288373%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117288373: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117099177
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117099177%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117099177: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117431475
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117431475%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117431475: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117362156
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117362156%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117362156: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117190866
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117190866%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117190866: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117399936
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117399936%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117399936: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116725518
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116725518%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116725518: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116930700
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116930700%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116930700: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116152685
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116152685%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116152685: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116016591
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116016591%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116016591: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 115997019
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115997019%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 115997019: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116931547
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116931547%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116931547: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117399393
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117399393%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117399393: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116496702
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116496702%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116496702: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117048263
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117048263%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117048263: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116945130
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116945130%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116945130: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117082695
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117082695%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117082695: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116152721
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116152721%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116152721: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116655276
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116655276%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116655276: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116928625
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116928625%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116928625: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116928605
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116928605%27 HTTP/1.1" 200 None
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116928605: 0
2025-12-01 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117570719
2025-12-01 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570719%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117570719: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117269087
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117269087%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117269087: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117271901
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117271901%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117271901: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117270372
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117270372%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117270372: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117570740
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570740%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117570740: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117421533
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117421533%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117421533: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117505585
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117505585%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117505585: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117272082
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117272082%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117272082: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117570049
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570049%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117570049: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117311708
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117311708%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117311708: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117570688
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570688%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117570688: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117452073
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117452073%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117452073: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117598232
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117598232%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117598232: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117632517
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117632517%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117632517: 1
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): publicsuffix.org:443
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://publicsuffix.org:443 "GET /list/public_suffix_list.dat HTTP/1.1" 200 86415
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117632563
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117632563%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117632563: 1
2025-12-01 19:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117516097
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117516097%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117516097: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117543969
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117543969%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117543969: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117539662
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117539662%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117539662: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117540360
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117540360%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117540360: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117572803
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117572803%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117572803: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117574494
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117574494%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117574494: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117556910
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117556910%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117556910: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117576795
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576795%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117576795: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117557862
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117557862%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117557862: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117550047
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550047%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117550047: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117571243
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117571243%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117571243: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117498763
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498763%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117498763: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117581512
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117581512%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117581512: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117569240
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117569240%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117569240: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117535309
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117535309%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117535309: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117504223
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117504223%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117504223: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117542051
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117542051%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117542051: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117515289
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117515289%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117515289: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117537363
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117537363%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117537363: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117581842
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117581842%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117581842: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117542115
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117542115%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117542115: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117550696
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550696%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117550696: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117593718
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117593718%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117593718: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117602588
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117602588%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117602588: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117602227
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117602227%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117602227: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 109140236
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27109140236%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 109140236: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117603221
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117603221%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117603221: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 53111162
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2753111162%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 53111162: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117555929
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117555929%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117555929: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117073655
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117073655%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117073655: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117498519
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498519%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117498519: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117030784
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117030784%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117030784: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117493107
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117493107%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117493107: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117498427
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498427%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117498427: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116509919
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116509919%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116509919: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116720970
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116720970%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116720970: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117455255
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117455255%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117455255: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117406735
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117406735%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117406735: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116321191
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116321191%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116321191: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117621114
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117621114%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117621114: 1
2025-12-01 19:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117498468
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498468%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117498468: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117515973
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117515973%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117515973: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117408595
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117408595%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117408595: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117189741
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117189741%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117189741: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117184599
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117184599%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117184599: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117539813
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117539813%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117539813: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117545284
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117545284%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117545284: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117452123
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117452123%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117452123: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117425377
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117425377%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117425377: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117569819
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117569819%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117569819: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117599337
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599337%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117599337: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117568753
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117568753%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117568753: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117121221
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117121221%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117121221: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117135963
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117135963%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117135963: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116884491
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116884491%27 HTTP/1.1" 200 None
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116884491: 0
2025-12-01 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117023546
2025-12-01 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117023546%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117023546: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117022539
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117022539%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117022539: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117023522
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117023522%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117023522: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117357391
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117357391%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117357391: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 114036273
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114036273%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 114036273: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117457838
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117457838%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117457838: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117273884
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117273884%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117273884: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116651075
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116651075%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116651075: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117217399
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117217399%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117217399: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117079065
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117079065%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117079065: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 115457692
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115457692%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 115457692: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117061078
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117061078%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117061078: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116994676
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116994676%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116994676: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117452490
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117452490%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117452490: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117310723
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117310723%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117310723: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117276677
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117276677%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117276677: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116857256
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116857256%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116857256: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117459032
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459032%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117459032: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 114998202
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114998202%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 114998202: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117117971
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117117971%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117117971: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117457472
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117457472%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117457472: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117341295
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117341295%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117341295: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117507342
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507342%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117507342: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116706380
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116706380%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116706380: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117527309
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117527309%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117527309: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117419626
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117419626%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117419626: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116639589
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116639589%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116639589: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117213849
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117213849%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117213849: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116419349
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116419349%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116419349: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117432748
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117432748%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117432748: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117085331
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117085331%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117085331: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117490116
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117490116%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117490116: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117433885
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117433885%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117433885: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117217311
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117217311%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117217311: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116800442
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116800442%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116800442: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117444266
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117444266%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117444266: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117576751
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576751%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117576751: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117488530
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117488530%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117488530: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117479608
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117479608%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117479608: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117144960
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117144960%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117144960: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117479539
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117479539%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117479539: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117459952
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459952%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117459952: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117459942
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459942%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117459942: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117144969
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117144969%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117144969: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117074559
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117074559%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117074559: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117179900
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117179900%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117179900: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117271696
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117271696%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117271696: 2
2025-12-01 19:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117292611
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117292611%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117292611: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116804294
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116804294%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116804294: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117406879
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117406879%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117406879: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117101013
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117101013%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117101013: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117429213
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117429213%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117429213: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117290423
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117290423%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117290423: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117274632
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117274632%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117274632: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117187271
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117187271%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117187271: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117452686
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117452686%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117452686: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117120743
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117120743%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117120743: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117310743
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117310743%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117310743: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117082207
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117082207%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117082207: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117362235
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117362235%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117362235: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116788960
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116788960%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116788960: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117422869
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117422869%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117422869: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117345096
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117345096%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117345096: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117508755
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117508755%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117508755: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116523683
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116523683%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116523683: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117238218
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117238218%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117238218: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117419466
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117419466%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117419466: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117424997
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117424997%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117424997: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117073748
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117073748%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117073748: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116988436
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116988436%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116988436: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117290602
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117290602%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117290602: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117292139
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117292139%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117292139: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117529182
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117529182%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117529182: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117336472
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117336472%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117336472: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117049908
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117049908%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117049908: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117030033
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117030033%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117030033: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116831329
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116831329%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116831329: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117404805
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117404805%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117404805: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117349312
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117349312%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117349312: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116455336
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116455336%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116455336: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117447427
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117447427%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117447427: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117210461
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117210461%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117210461: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117188762
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117188762%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117188762: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117214325
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117214325%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117214325: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117544347
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117544347%27 HTTP/1.1" 200 None
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117544347: 0
2025-12-01 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117447500
2025-12-01 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117447500%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117447500: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117165419
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117165419%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117165419: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117609015
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117609015%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117609015: 1
2025-12-01 19:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117405887
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117405887%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117405887: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117445447
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117445447%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117445447: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117636439
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117636439%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117636439: 1
2025-12-01 19:00:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-01 19:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117422764
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117422764%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117422764: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117471356
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117471356%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117471356: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117327695
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117327695%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117327695: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117274540
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117274540%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117274540: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 116674930
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116674930%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 116674930: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117442299
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117442299%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117442299: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117555734
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117555734%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117555734: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117581980
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117581980%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117581980: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117422415
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117422415%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117422415: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 115294363
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115294363%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 115294363: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117553459
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117553459%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117553459: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117553753
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117553753%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117553753: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117496386
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117496386%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117496386: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117517999
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517999%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117517999: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117517588
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517588%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117517588: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117070544
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117070544%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117070544: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117517475
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517475%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117517475: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117517795
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517795%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117517795: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117459104
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459104%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117459104: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117507922
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507922%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117507922: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117267875
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117267875%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117267875: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117494260
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117494260%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117494260: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117267865
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117267865%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117267865: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117267902
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117267902%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117267902: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117407477
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407477%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117407477: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117100098
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117100098%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117100098: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117548876
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117548876%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117548876: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117514814
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117514814%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117514814: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117550109
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550109%27 HTTP/1.1" 200 None
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117550109: 0
2025-12-01 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117447083
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117447083%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117447083: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117507292
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507292%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117507292: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117374304
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117374304%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117374304: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117374356
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117374356%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117374356: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117374439
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117374439%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117374439: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117453051
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117453051%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117453051: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117523804
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117523804%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117523804: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117537050
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117537050%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117537050: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117323884
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117323884%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117323884: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117517985
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517985%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117517985: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117449968
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117449968%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117449968: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117551950
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117551950%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117551950: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117265330
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117265330%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117265330: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117440886
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117440886%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117440886: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117444967
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117444967%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117444967: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117326194
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117326194%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117326194: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117565071
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117565071%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117565071: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117440907
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117440907%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117440907: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117450542
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117450542%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117450542: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117266272
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117266272%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117266272: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117506317
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117506317%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117506317: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117500624
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117500624%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117500624: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117272731
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117272731%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117272731: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117426992
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117426992%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117426992: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117523252
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117523252%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117523252: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117425969
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117425969%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117425969: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117240197
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117240197%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117240197: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117539274
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117539274%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117539274: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117450014
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117450014%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117450014: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117573197
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573197%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117573197: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117254197
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117254197%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117254197: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117579237
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117579237%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117579237: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117573049
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573049%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117573049: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117518990
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117518990%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117518990: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117474058
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117474058%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117474058: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117293082
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117293082%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117293082: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117489830
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117489830%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117489830: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117456374
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117456374%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117456374: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117573622
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573622%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117573622: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117573893
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573893%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117573893: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117460212
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117460212%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117460212: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117511008
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117511008%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117511008: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117581422
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117581422%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117581422: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117584097
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584097%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117584097: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117164114
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117164114%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117164114: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117475684
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117475684%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117475684: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117597991
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117597991%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117597991: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117597964
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117597964%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117597964: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117444914
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117444914%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117444914: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117532070
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117532070%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117532070: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117275648
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117275648%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117275648: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117370840
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117370840%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117370840: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 116816864
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116816864%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 116816864: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117511014
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117511014%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117511014: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117442908
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117442908%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117442908: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117418653
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117418653%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117418653: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117402164
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117402164%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117402164: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117545961
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117545961%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117545961: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117443109
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117443109%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117443109: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117402228
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117402228%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117402228: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117240825
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117240825%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117240825: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117491510
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117491510%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117491510: 1
2025-12-01 19:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117422403
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117422403%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117422403: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117247051
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117247051%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117247051: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 116807925
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116807925%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 116807925: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117399764
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117399764%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117399764: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117572011
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117572011%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117572011: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117572022
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117572022%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117572022: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117572036
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117572036%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117572036: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117571999
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117571999%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117571999: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117492135
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117492135%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117492135: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117253439
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117253439%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117253439: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 116891450
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116891450%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 116891450: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 116891404
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116891404%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 116891404: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 116891417
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116891417%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 116891417: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117458552
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117458552%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117458552: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117216157
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117216157%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117216157: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 116895357
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116895357%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 116895357: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117444372
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117444372%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117444372: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117348473
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117348473%27 HTTP/1.1" 200 None
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117348473: 0
2025-12-01 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117148543
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117148543%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117148543: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117551156
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117551156%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117551156: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117415483
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117415483%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117415483: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117441244
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441244%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117441244: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117441204
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441204%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117441204: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117441307
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441307%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117441307: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117441019
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441019%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117441019: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117441892
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441892%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117441892: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117415492
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117415492%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117415492: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117441882
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441882%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117441882: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117441850
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441850%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117441850: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117441140
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441140%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117441140: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117441120
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441120%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117441120: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117441149
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441149%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117441149: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117441111
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441111%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117441111: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117441007
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441007%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117441007: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117404928
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117404928%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117404928: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117441860
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441860%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117441860: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117404939
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117404939%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117404939: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117404919
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117404919%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117404919: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117441190
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441190%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117441190: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117052977
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117052977%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117052977: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117441870
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441870%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117441870: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117441337
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441337%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117441337: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117441325
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441325%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117441325: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117441346
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441346%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117441346: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117497624
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117497624%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117497624: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 116855883
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116855883%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 116855883: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117475216
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117475216%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117475216: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117434938
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117434938%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117434938: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117448541
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117448541%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117448541: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117510413
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117510413%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117510413: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117272128
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117272128%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117272128: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117482022
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117482022%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117482022: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117439361
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117439361%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117439361: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117423639
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117423639%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117423639: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117461164
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117461164%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117461164: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117555034
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117555034%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117555034: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117555641
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117555641%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117555641: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117061695
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117061695%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117061695: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117457340
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117457340%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117457340: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 116866753
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116866753%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 116866753: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117598902
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117598902%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117598902: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117441537
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441537%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117441537: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117366912
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117366912%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117366912: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117441410
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441410%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117441410: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117585284
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585284%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117585284: 1
2025-12-01 19:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117632517?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117573720
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573720%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117573720: 1
2025-12-01 19:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117578438
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117578438%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117578438: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117598161
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117598161%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117598161: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117599013
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599013%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117599013: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117585302
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585302%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117585302: 1
2025-12-01 19:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117543370
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117543370%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117543370: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117051310
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117051310%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117051310: 2
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117175584
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117175584%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117175584: 2
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117243027
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117243027%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117243027: 2
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117243071
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117243071%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117243071: 2
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117632517, 'registration': 'SR18GBE', 'account': 'MAN037', 'make': 'FORD', 'model': 'FIESTA DIESEL HATCHBACK', 'derivative': '1.5 TDCi Zetec 5dr', 'mileage': 66353, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-01T17:30Z', 'lot': 1081, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-08-30', 'fuel': 'Diesel', 'motExpiry': '2026-08-09', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SR18GBE/2025-12-01/image/c35a27b3-6085-4f6d-9a88-b702803029de_removebg.jpg?w=600', 'https://abimg003.imgix.net/SR18GBE/2025-12-01/image/6463ec47-ff69-4826-aedf-5ac2b35c4065_removebg.jpg?w=600', 'https://abimg003.imgix.net/SR18GBE/2025-12-01/image/860a667e-ceeb-466f-bcc5-ebbac9c8a6e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SR18GBE/2025-12-01/image/4e9a8319-3cb7-4ec2-8244-18f777b181e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/SR18GBE/2025-12-01/image/2f415d98-1d27-4e50-b74f-d8a5a01545ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/SR18GBE/2025-12-01/image/667fa8c3-8d8a-4b85-b10d-df0c43337b4d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SR18GBE/2025-12-01/image/ebf1de41-86ac-48e1-b595-f34af535f90c_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 05/20 13K - 12/21 17K - 04/23 20K -  04/24 32K - 09/24 42K -- 04/25 53K -', 'remarks': 'VOSA STATES 18K- 20K - 38K - 59K -SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 96, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/05454e9e-c576-4efc-bfb6-b26b4ce3b84d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117632517, 'registration': 'SR18GBE', 'account': 'MAN037', 'make': 'FORD', 'model': 'FIESTA DIESEL HATCHBACK', 'derivative': '1.5 TDCi Zetec 5dr', 'mileage': 66353, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-01T17:30Z', 'lot': 1081, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-08-30', 'fuel': 'Diesel', 'motExpiry': '2026-08-09', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SR18GBE/2025-12-01/image/c35a27b3-6085-4f6d-9a88-b702803029de_removebg.jpg?w=600', 'https://abimg003.imgix.net/SR18GBE/2025-12-01/image/6463ec47-ff69-4826-aedf-5ac2b35c4065_removebg.jpg?w=600', 'https://abimg003.imgix.net/SR18GBE/2025-12-01/image/860a667e-ceeb-466f-bcc5-ebbac9c8a6e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SR18GBE/2025-12-01/image/4e9a8319-3cb7-4ec2-8244-18f777b181e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/SR18GBE/2025-12-01/image/2f415d98-1d27-4e50-b74f-d8a5a01545ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/SR18GBE/2025-12-01/image/667fa8c3-8d8a-4b85-b10d-df0c43337b4d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SR18GBE/2025-12-01/image/ebf1de41-86ac-48e1-b595-f34af535f90c_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 05/20 13K - 12/21 17K - 04/23 20K -  04/24 32K - 09/24 42K -- 04/25 53K -', 'remarks': 'VOSA STATES 18K- 20K - 38K - 59K -SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 96, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/05454e9e-c576-4efc-bfb6-b26b4ce3b84d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c34eeee2-e66c-53a2-a6bd-79ec8aa895ce with identifier: 117632517
2025-12-01 19:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c34eeee2-e66c-53a2-a6bd-79ec8aa895ce with scrape type 1
2025-12-01 19:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item c34eeee2-e66c-53a2-a6bd-79ec8aa895ce
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSR18GBE%252F2025-12-01%252Fimage%252Fc35a27b3-6085-4f6d-9a88-b702803029de_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SR18GBE/2025-12-01/image/c35a27b3-6085-4f6d-9a88-b702803029de_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117175645
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117175645%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117175645: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117131550
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117131550%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117131550: 2
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSR18GBE%252F2025-12-01%252Fimage%252F6463ec47-ff69-4826-aedf-5ac2b35c4065_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SR18GBE/2025-12-01/image/6463ec47-ff69-4826-aedf-5ac2b35c4065_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117635994
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117635994%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117635994: 1
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSR18GBE%252F2025-12-01%252Fimage%252F860a667e-ceeb-466f-bcc5-ebbac9c8a6e7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SR18GBE/2025-12-01/image/860a667e-ceeb-466f-bcc5-ebbac9c8a6e7_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117553638
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117553638%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117553638: 1
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSR18GBE%252F2025-12-01%252Fimage%252F4e9a8319-3cb7-4ec2-8244-18f777b181e5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SR18GBE/2025-12-01/image/4e9a8319-3cb7-4ec2-8244-18f777b181e5_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 116755943
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116755943%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 116755943: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117131446
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117131446%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117131446: 2
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSR18GBE%252F2025-12-01%252Fimage%252F2f415d98-1d27-4e50-b74f-d8a5a01545ce_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SR18GBE/2025-12-01/image/2f415d98-1d27-4e50-b74f-d8a5a01545ce_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117424411
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117424411%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117424411: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117440690
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117440690%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117440690: 2
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSR18GBE%252F2025-12-01%252Fimage%252F667fa8c3-8d8a-4b85-b10d-df0c43337b4d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SR18GBE/2025-12-01/image/667fa8c3-8d8a-4b85-b10d-df0c43337b4d_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117121214
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117121214%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117121214: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117424383
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117424383%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117424383: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117424304
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117424304%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117424304: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 116989244
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116989244%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 116989244: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117290737
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117290737%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117290737: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117242983
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117242983%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117242983: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117330721
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117330721%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117330721: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117288965
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117288965%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117288965: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 115431227
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115431227%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 115431227: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117400527
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117400527%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117400527: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117400496
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117400496%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117400496: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 116134889
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116134889%27 HTTP/1.1" 200 None
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Scrape type for 116134889: 0
2025-12-01 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117576600
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576600%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117576600: 0
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117576849
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576849%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117576849: 0
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 114089759
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114089759%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 114089759: 0
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117508089
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117508089%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117508089: 0
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117024353
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024353%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117024353: 2
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSR18GBE%252F2025-12-01%252Fimage%252Febf1de41-86ac-48e1-b595-f34af535f90c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SR18GBE/2025-12-01/image/ebf1de41-86ac-48e1-b595-f34af535f90c_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117508080
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117508080%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117508080: 0
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117506668
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117506668%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117506668: 0
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117433630
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117433630%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117433630: 0
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 116671419
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116671419%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 116671419: 0
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117635092
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117635092%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117635092: 1
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117331639
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117331639%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117331639: 0
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117288542
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117288542%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117288542: 2
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117440649
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117440649%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117440649: 2
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117289360
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117289360%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117289360: 2
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117131404
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117131404%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117131404: 2
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117123611
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117123611%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117123611: 2
2025-12-01 19:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117632563?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117633088
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117633088%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117633088: 1
2025-12-01 19:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117024415
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024415%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117024415: 2
2025-12-01 19:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117621114?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117024058
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024058%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117024058: 2
2025-12-01 19:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117031158
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117031158%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117031158: 2
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117267405
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117267405%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117267405: 0
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117579419
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117579419%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117579419: 1
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117598923
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117598923%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117598923: 0
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 116994755
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116994755%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 116994755: 0
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117422410
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117422410%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117422410: 0
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117576078
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576078%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117576078: 1
2025-12-01 19:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SR18GBE/2025-12-01/image/c35a27b3-6085-4f6d-9a88-b702803029de_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117632517?view=catalogue)
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117546474
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117546474%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117546474: 0
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117573571
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573571%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117573571: 0
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117494253
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117494253%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117494253: 0
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 116918961
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116918961%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 116918961: 0
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117493567
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117493567%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117493567: 0
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117535067
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117535067%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117535067: 0
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117546450
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117546450%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117546450: 0
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117546506
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117546506%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117546506: 0
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117546520
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117546520%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117546520: 0
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117544119
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117544119%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117544119: 0
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117546419
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117546419%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117546419: 0
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117459934
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459934%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117459934: 0
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117563683
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117563683%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117563683: 1
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117632563, 'registration': 'WL19RLV', 'account': 'MAN037', 'make': 'MG MOTOR UK', 'model': 'MG3 HATCHBACK', 'derivative': '1.5 VTi-TECH Exclusive 5dr', 'mileage': 42899, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-01T17:30Z', 'lot': 1084, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-06-29', 'fuel': 'Petrol', 'motExpiry': '2025-07-12', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WL19RLV/2025-12-01/image/eb9b8c35-4d6f-4147-ad12-5cabec422197_removebg.jpg?w=600', 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/d2a24375-171e-4501-8a81-8a55efa8c542_removebg.jpg?w=600', 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/4d574f6b-6e0d-4c9c-b72c-426fe5c5e208_removebg.jpg?w=600', 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/af3fc48b-79a9-46a1-a39f-3f4904e08f5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/f0166b53-82f4-4b4b-aef1-7df1a130b02d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/4bcfea0b-3877-4b2b-911d-d7813da4fcd9_removebg.jpg?w=600', 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/61489502-b40d-4f40-95bf-8b4d75a802d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/ca6a3055-4e9c-42b6-93e6-7a8bb1e6056e_removebg.jpg?w=600'], 'colour': 'YELLOW', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 12/20 33K', 'remarks': 'VOSA STATES 18K - 27K - 36K- 42K (FAIL) - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a607f00c-bc41-4c01-9424-3a706f794c54.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117632563, 'registration': 'WL19RLV', 'account': 'MAN037', 'make': 'MG MOTOR UK', 'model': 'MG3 HATCHBACK', 'derivative': '1.5 VTi-TECH Exclusive 5dr', 'mileage': 42899, 'mileageWarranty': False, 'type': 'car', 'saleId': 17964, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-01T17:30Z', 'lot': 1084, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-06-29', 'fuel': 'Petrol', 'motExpiry': '2025-07-12', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WL19RLV/2025-12-01/image/eb9b8c35-4d6f-4147-ad12-5cabec422197_removebg.jpg?w=600', 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/d2a24375-171e-4501-8a81-8a55efa8c542_removebg.jpg?w=600', 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/4d574f6b-6e0d-4c9c-b72c-426fe5c5e208_removebg.jpg?w=600', 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/af3fc48b-79a9-46a1-a39f-3f4904e08f5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/f0166b53-82f4-4b4b-aef1-7df1a130b02d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/4bcfea0b-3877-4b2b-911d-d7813da4fcd9_removebg.jpg?w=600', 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/61489502-b40d-4f40-95bf-8b4d75a802d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/ca6a3055-4e9c-42b6-93e6-7a8bb1e6056e_removebg.jpg?w=600'], 'colour': 'YELLOW', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 12/20 33K', 'remarks': 'VOSA STATES 18K - 27K - 36K- 42K (FAIL) - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a607f00c-bc41-4c01-9424-3a706f794c54.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 315a462f-b1fb-5767-99b3-d3e45f95653b with identifier: 117632563
2025-12-01 19:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 315a462f-b1fb-5767-99b3-d3e45f95653b with scrape type 1
2025-12-01 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 315a462f-b1fb-5767-99b3-d3e45f95653b
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWL19RLV%252F2025-12-01%252Fimage%252Feb9b8c35-4d6f-4147-ad12-5cabec422197_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WL19RLV/2025-12-01/image/eb9b8c35-4d6f-4147-ad12-5cabec422197_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117621114, 'registration': 'EA19YRV', 'account': 'CAR001', 'make': 'HYUNDAI', 'model': 'I10 HATCHBACK', 'derivative': '1.2 SE 5dr', 'mileage': 73975, 'mileageWarranty': False, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-01T17:30Z', 'lot': 2123, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-03-12', 'fuel': 'Petrol', 'motExpiry': '2026-10-16', 'doors': 5, 'engineSize': 1248, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EA19YRV/2025-12-01/image/fedeaa24-2acb-49a3-a2aa-22d55c64d143_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19YRV/2025-12-01/image/2201c716-4048-4559-b8f5-7cd42535a183_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19YRV/2025-12-01/image/4a1c666f-01a8-405c-9dc2-d49f862447aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19YRV/2025-12-01/image/c4ec43eb-d5cb-456b-aee2-a3ffe38f099f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19YRV/2025-12-01/image/b75c6da1-844f-4784-bf20-81735ae1911d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19YRV/2025-12-01/image/6bbaf1fb-75ea-4a14-b4ed-06bf0498a82f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19YRV/2025-12-01/image/b99607bd-63b7-4065-a0c5-dda5e31dee44_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19YRV/2025-12-01/image/37233342-b6c1-4aae-9ee9-2ffe6be1a099_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19YRV/2025-12-01/image/a8860e8a-3fb3-4c6e-93b3-dabae7aef4b9_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 11/19- 9K, 06/20- 19K, 04/21- 29K, 01/22- 38K, 09/22- 48K, 04/23- 49K, 11/23- 54K, 11/24- 63K, 10/25- 72K', 'remarks': 'VOSA STATES 49K, 54K, 63K, 72K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/26f7819b-6439-497c-b197-0608056406a7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117621114, 'registration': 'EA19YRV', 'account': 'CAR001', 'make': 'HYUNDAI', 'model': 'I10 HATCHBACK', 'derivative': '1.2 SE 5dr', 'mileage': 73975, 'mileageWarranty': False, 'type': 'car', 'saleId': 17963, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-01T17:30Z', 'lot': 2123, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-03-12', 'fuel': 'Petrol', 'motExpiry': '2026-10-16', 'doors': 5, 'engineSize': 1248, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EA19YRV/2025-12-01/image/fedeaa24-2acb-49a3-a2aa-22d55c64d143_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19YRV/2025-12-01/image/2201c716-4048-4559-b8f5-7cd42535a183_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19YRV/2025-12-01/image/4a1c666f-01a8-405c-9dc2-d49f862447aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19YRV/2025-12-01/image/c4ec43eb-d5cb-456b-aee2-a3ffe38f099f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19YRV/2025-12-01/image/b75c6da1-844f-4784-bf20-81735ae1911d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19YRV/2025-12-01/image/6bbaf1fb-75ea-4a14-b4ed-06bf0498a82f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19YRV/2025-12-01/image/b99607bd-63b7-4065-a0c5-dda5e31dee44_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19YRV/2025-12-01/image/37233342-b6c1-4aae-9ee9-2ffe6be1a099_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA19YRV/2025-12-01/image/a8860e8a-3fb3-4c6e-93b3-dabae7aef4b9_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 11/19- 9K, 06/20- 19K, 04/21- 29K, 01/22- 38K, 09/22- 48K, 04/23- 49K, 11/23- 54K, 11/24- 63K, 10/25- 72K', 'remarks': 'VOSA STATES 49K, 54K, 63K, 72K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/26f7819b-6439-497c-b197-0608056406a7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89214aa6-43de-5869-9911-0711c93784fc with identifier: 117621114
2025-12-01 19:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89214aa6-43de-5869-9911-0711c93784fc with scrape type 1
2025-12-01 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 89214aa6-43de-5869-9911-0711c93784fc
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA19YRV%252F2025-12-01%252Fimage%252Ffedeaa24-2acb-49a3-a2aa-22d55c64d143_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19YRV/2025-12-01/image/fedeaa24-2acb-49a3-a2aa-22d55c64d143_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117215946
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117215946%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117215946: 0
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117579570
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117579570%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117579570: 1
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWL19RLV%252F2025-12-01%252Fimage%252Fd2a24375-171e-4501-8a81-8a55efa8c542_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WL19RLV/2025-12-01/image/d2a24375-171e-4501-8a81-8a55efa8c542_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA19YRV%252F2025-12-01%252Fimage%252F2201c716-4048-4559-b8f5-7cd42535a183_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19YRV/2025-12-01/image/2201c716-4048-4559-b8f5-7cd42535a183_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117271696?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117636439?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117609015?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f37bed0>
2025-12-01 19:00:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c34eeee2-e66c-53a2-a6bd-79ec8aa895ce/c34eeee2-e66c-53a2-a6bd-79ec8aa895ce_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSR18GBE%252F2025-12-01%252Fimage%252Fc35a27b3-6085-4f6d-9a88-b702803029de_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SR18GBE/2025-12-01/image/c35a27b3-6085-4f6d-9a88-b702803029de_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c34eeee2-e66c-53a2-a6bd-79ec8aa895ce
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117348031
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117348031%27 HTTP/1.1" 200 None
2025-12-01 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117348031: 1
2025-12-01 19:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWL19RLV%252F2025-12-01%252Fimage%252F4d574f6b-6e0d-4c9c-b72c-426fe5c5e208_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WL19RLV/2025-12-01/image/4d574f6b-6e0d-4c9c-b72c-426fe5c5e208_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA19YRV%252F2025-12-01%252Fimage%252F4a1c666f-01a8-405c-9dc2-d49f862447aa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19YRV/2025-12-01/image/4a1c666f-01a8-405c-9dc2-d49f862447aa_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 117576484
2025-12-01 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576484%27 HTTP/1.1" 200 None
2025-12-01 19:00:27 [astonbarclay.gb] INFO: Scrape type for 117576484: 0
2025-12-01 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 117583759
2025-12-01 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117583759%27 HTTP/1.1" 200 None
2025-12-01 19:00:27 [astonbarclay.gb] INFO: Scrape type for 117583759: 1
2025-12-01 19:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117491510?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117585284?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWL19RLV%252F2025-12-01%252Fimage%252Faf3fc48b-79a9-46a1-a39f-3f4904e08f5d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WL19RLV/2025-12-01/image/af3fc48b-79a9-46a1-a39f-3f4904e08f5d_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA19YRV%252F2025-12-01%252Fimage%252Fc4ec43eb-d5cb-456b-aee2-a3ffe38f099f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19YRV/2025-12-01/image/c4ec43eb-d5cb-456b-aee2-a3ffe38f099f_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 117584632
2025-12-01 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584632%27 HTTP/1.1" 200 None
2025-12-01 19:00:27 [astonbarclay.gb] INFO: Scrape type for 117584632: 0
2025-12-01 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 117585575
2025-12-01 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585575%27 HTTP/1.1" 200 None
2025-12-01 19:00:27 [astonbarclay.gb] INFO: Scrape type for 117585575: 1
2025-12-01 19:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117573720?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117271696, 'registration': 'FL72JZO', 'account': 'ZEN002', 'make': 'MINI', 'model': 'COUNTRYMAN HATCHBACK', 'derivative': '1.5 Cooper S E Classic ALL4 PHEV 5dr Auto[Comfort]', 'mileage': 45815, 'mileageWarranty': True, 'type': 'car', 'saleId': 17967, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-02T10:00Z', 'lot': 103, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-11-14', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-10-01', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FL72JZO/2025-11-19/image/6486561d-67ea-4cbf-8451-3e73d9cedea5_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZO/2025-11-19/image/c40cf97b-4047-4387-bcfb-6e22f4c487db_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZO/2025-11-19/image/cd1ac63e-87d2-46c1-9c33-cf4e37a5302a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZO/2025-11-19/image/02cf3bcc-3e17-4143-b7ae-df54d451308a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZO/2025-11-19/image/ef00c160-1b0b-42b2-90ad-ac8d868c2ea1_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZO/2025-11-19/image/ee5338ce-fe3a-4096-8c0e-74c0140354de_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZO/2025-11-19/image/61f4791a-cec9-4610-bf7b-60b9a1b1b31e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZO/2025-11-19/image/aca2abf3-a447-4a44-ad76-99ed5c784e03_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZO/2025-11-19/image/81d8fb21-25a3-4fb5-b302-77eb678cf594_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZO/2025-11-19/image/bb6f8ef0-b582-4c39-91d1-8fede3ac0355_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/24 18k, 7/25 38k, 11/25 45k,', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 40, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/92f2cc35-e78e-42d1-b44e-1500b07c0f41.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-01 19:00:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117271696, 'registration': 'FL72JZO', 'account': 'ZEN002', 'make': 'MINI', 'model': 'COUNTRYMAN HATCHBACK', 'derivative': '1.5 Cooper S E Classic ALL4 PHEV 5dr Auto[Comfort]', 'mileage': 45815, 'mileageWarranty': True, 'type': 'car', 'saleId': 17967, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-02T10:00Z', 'lot': 103, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-11-14', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-10-01', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FL72JZO/2025-11-19/image/6486561d-67ea-4cbf-8451-3e73d9cedea5_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZO/2025-11-19/image/c40cf97b-4047-4387-bcfb-6e22f4c487db_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZO/2025-11-19/image/cd1ac63e-87d2-46c1-9c33-cf4e37a5302a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZO/2025-11-19/image/02cf3bcc-3e17-4143-b7ae-df54d451308a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZO/2025-11-19/image/ef00c160-1b0b-42b2-90ad-ac8d868c2ea1_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZO/2025-11-19/image/ee5338ce-fe3a-4096-8c0e-74c0140354de_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZO/2025-11-19/image/61f4791a-cec9-4610-bf7b-60b9a1b1b31e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZO/2025-11-19/image/aca2abf3-a447-4a44-ad76-99ed5c784e03_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZO/2025-11-19/image/81d8fb21-25a3-4fb5-b302-77eb678cf594_removebg.jpg?w=600', 'https://abimg003.imgix.net/FL72JZO/2025-11-19/image/bb6f8ef0-b582-4c39-91d1-8fede3ac0355_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/24 18k, 7/25 38k, 11/25 45k,', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 40, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/92f2cc35-e78e-42d1-b44e-1500b07c0f41.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-01 19:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f335bcf4-d708-5a5a-ba0a-861028eb57ea with identifier: 117271696
2025-12-01 19:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f335bcf4-d708-5a5a-ba0a-861028eb57ea with scrape type 2
2025-12-01 19:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f335bcf4-d708-5a5a-ba0a-861028eb57ea with scrape type 2
2025-12-01 19:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f335bcf4-d708-5a5a-ba0a-861028eb57ea, identifier: 117271696
2025-12-01 19:00:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117636439, 'registration': 'DE17YWV', 'account': 'DAC001', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6 GDi ISG 2 5dr', 'mileage': 70290, 'mileageWarranty': True, 'type': 'car', 'saleId': 17966, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 216}, 'saleStart': '2025-12-02T10:00Z', 'lot': 146, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-02-12', 'doors': 5, 'engineSize': 1591, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DE17YWV/2025-12-01/image/02290c2b-fba6-4006-a1eb-be44ffc2f211_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE17YWV/2025-12-01/image/c78ece7c-8885-46ad-ad9f-c930ca8c36cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE17YWV/2025-12-01/image/983b7f49-2ec0-4f09-88d7-6da5e9dd26d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE17YWV/2025-12-01/image/43ceb04c-2be2-45c9-bdd8-7e129924f0b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE17YWV/2025-12-01/image/cd7be7de-093c-4c2d-a0f6-104567d25a66_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE17YWV/2025-12-01/image/ceac24e4-53c0-48f2-be99-91fb0dc82a3b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE17YWV/2025-12-01/image/f1b9b5b3-b66a-409c-8624-6d465ff90acf_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE17YWV/2025-12-01/image/67195d9c-b82b-45ce-b970-38ec4af90eae_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE17YWV/2025-12-01/image/3e549e1c-5ec9-4d0c-b2d1-329320697f86_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/18-7k, 03/19-13k, 02/20-19k, 01/21-29k, 02/22-41k, 02/23-50k, 01/24-57k, 01/25-65k,', 'remarks': 'vosa states 19k, 29k, 41k, 50k, 57k, 65k,', 'virtual': False, 'seller': 'Dace', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 147, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ce22e036-c0f3-4349-8670-849671903150.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117636439, 'registration': 'DE17YWV', 'account': 'DAC001', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6 GDi ISG 2 5dr', 'mileage': 70290, 'mileageWarranty': True, 'type': 'car', 'saleId': 17966, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 216}, 'saleStart': '2025-12-02T10:00Z', 'lot': 146, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-02-12', 'doors': 5, 'engineSize': 1591, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DE17YWV/2025-12-01/image/02290c2b-fba6-4006-a1eb-be44ffc2f211_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE17YWV/2025-12-01/image/c78ece7c-8885-46ad-ad9f-c930ca8c36cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE17YWV/2025-12-01/image/983b7f49-2ec0-4f09-88d7-6da5e9dd26d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE17YWV/2025-12-01/image/43ceb04c-2be2-45c9-bdd8-7e129924f0b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE17YWV/2025-12-01/image/cd7be7de-093c-4c2d-a0f6-104567d25a66_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE17YWV/2025-12-01/image/ceac24e4-53c0-48f2-be99-91fb0dc82a3b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE17YWV/2025-12-01/image/f1b9b5b3-b66a-409c-8624-6d465ff90acf_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE17YWV/2025-12-01/image/67195d9c-b82b-45ce-b970-38ec4af90eae_removebg.jpg?w=600', 'https://abimg003.imgix.net/DE17YWV/2025-12-01/image/3e549e1c-5ec9-4d0c-b2d1-329320697f86_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/18-7k, 03/19-13k, 02/20-19k, 01/21-29k, 02/22-41k, 02/23-50k, 01/24-57k, 01/25-65k,', 'remarks': 'vosa states 19k, 29k, 41k, 50k, 57k, 65k,', 'virtual': False, 'seller': 'Dace', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 147, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ce22e036-c0f3-4349-8670-849671903150.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fc61c1e-27fc-5109-8c11-3436b81e5022 with identifier: 117636439
2025-12-01 19:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fc61c1e-27fc-5109-8c11-3436b81e5022 with scrape type 1
2025-12-01 19:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 6fc61c1e-27fc-5109-8c11-3436b81e5022
2025-12-01 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDE17YWV%252F2025-12-01%252Fimage%252F02290c2b-fba6-4006-a1eb-be44ffc2f211_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE17YWV/2025-12-01/image/02290c2b-fba6-4006-a1eb-be44ffc2f211_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117609015, 'registration': 'YR66YCG', 'account': 'DAC001', 'make': 'AUDI', 'model': 'A6 DIESEL SALOON', 'derivative': '2.0 TDI Quattro SE Executive 4dr S Tronic', 'mileage': 68767, 'mileageWarranty': True, 'type': 'car', 'saleId': 17966, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 216}, 'saleStart': '2025-12-02T10:00Z', 'lot': 144, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-09-30', 'fuel': 'Diesel', 'motExpiry': '2026-11-09', 'doors': 4, 'engineSize': 1968, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/YR66YCG/2025-12-01/image/cc49f354-c540-4000-bb15-d5dc11dc8098_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR66YCG/2025-12-01/image/afda7eb8-81b8-4f72-bed3-c7f8c206c83a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR66YCG/2025-12-01/image/d6c3dea5-047b-443e-8428-99ebeb8bbe36_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR66YCG/2025-12-01/image/63f13649-bbea-4df9-bd58-9089925d3ae6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR66YCG/2025-12-01/image/c5931db0-1018-4af3-830a-5cb191d14c39_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR66YCG/2025-12-01/image/c7105256-bcd1-4d20-8846-5f0fe0d1d477_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR66YCG/2025-12-01/image/1416b83a-0a0d-4e37-b01d-8a7e38bc0040_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR66YCG/2025-12-01/image/0c12bf38-d294-4916-af8c-afb2632f1339_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 11/22-41k,', 'remarks': 'vosa states 33k, 41k, 51k, 65k, 67k, 68k,', 'virtual': False, 'seller': 'Dace', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b6c91132-9e88-4110-b0a4-9c02d7dcf8c8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117609015, 'registration': 'YR66YCG', 'account': 'DAC001', 'make': 'AUDI', 'model': 'A6 DIESEL SALOON', 'derivative': '2.0 TDI Quattro SE Executive 4dr S Tronic', 'mileage': 68767, 'mileageWarranty': True, 'type': 'car', 'saleId': 17966, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 216}, 'saleStart': '2025-12-02T10:00Z', 'lot': 144, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-09-30', 'fuel': 'Diesel', 'motExpiry': '2026-11-09', 'doors': 4, 'engineSize': 1968, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/YR66YCG/2025-12-01/image/cc49f354-c540-4000-bb15-d5dc11dc8098_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR66YCG/2025-12-01/image/afda7eb8-81b8-4f72-bed3-c7f8c206c83a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR66YCG/2025-12-01/image/d6c3dea5-047b-443e-8428-99ebeb8bbe36_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR66YCG/2025-12-01/image/63f13649-bbea-4df9-bd58-9089925d3ae6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR66YCG/2025-12-01/image/c5931db0-1018-4af3-830a-5cb191d14c39_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR66YCG/2025-12-01/image/c7105256-bcd1-4d20-8846-5f0fe0d1d477_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR66YCG/2025-12-01/image/1416b83a-0a0d-4e37-b01d-8a7e38bc0040_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR66YCG/2025-12-01/image/0c12bf38-d294-4916-af8c-afb2632f1339_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 11/22-41k,', 'remarks': 'vosa states 33k, 41k, 51k, 65k, 67k, 68k,', 'virtual': False, 'seller': 'Dace', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b6c91132-9e88-4110-b0a4-9c02d7dcf8c8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 806e8254-da45-58a2-9827-dc16cca75b5c with identifier: 117609015
2025-12-01 19:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 806e8254-da45-58a2-9827-dc16cca75b5c with scrape type 1
2025-12-01 19:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 806e8254-da45-58a2-9827-dc16cca75b5c
2025-12-01 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYR66YCG%252F2025-12-01%252Fimage%252Fcc49f354-c540-4000-bb15-d5dc11dc8098_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR66YCG/2025-12-01/image/cc49f354-c540-4000-bb15-d5dc11dc8098_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWL19RLV%252F2025-12-01%252Fimage%252Ff0166b53-82f4-4b4b-aef1-7df1a130b02d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WL19RLV/2025-12-01/image/f0166b53-82f4-4b4b-aef1-7df1a130b02d_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA19YRV%252F2025-12-01%252Fimage%252Fb75c6da1-844f-4784-bf20-81735ae1911d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19YRV/2025-12-01/image/b75c6da1-844f-4784-bf20-81735ae1911d_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f335bcf4-d708-5a5a-ba0a-861028eb57ea with identifier: 117271696
2025-12-01 19:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-01 19:00:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GREY HTTP/1.1" 200 None
2025-12-01 19:00:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-01 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-01 19:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-01 19:00:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol%2FPlugin+Electric+Hybrid HTTP/1.1" 200 None
2025-12-01 19:00:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-01 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-01 19:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f335bcf4-d708-5a5a-ba0a-861028eb57ea with identifier: 117271696
2025-12-01 19:00:28 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f335bcf4-d708-5a5a-ba0a-861028eb57ea with identifier: 117271696 to the API
2025-12-01 19:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117271696?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 40,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-02T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'f335bcf4-d708-5a5a-ba0a-861028eb57ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'FL72JZO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117271696',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'MINI',
 'model': 'COUNTRYMAN HATCHBACK',
 'odometer': 45815,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-14',
 'seller_name': 'Zenith',
 'title': 'MINI COUNTRYMAN HATCHBACK 1.5 Cooper S E Classic ALL4 PHEV 5dr '
          'Auto[Comfort]',
 'transmission': 'automatic',
 'trim': '1.5 Cooper S E Classic ALL4 PHEV 5dr Auto[Comfort]',
 'vin': None,
 'year': 2022}
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117271696%27 HTTP/1.1" 200 None
2025-12-01 19:00:29 [astonbarclay.gb] INFO: Saving data for 117271696: {'auction_closing_time': 1764669600.0, 'created_time': 1763751706.43619, 'last_price_update_time': 1764615629.201051}
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117271696') HTTP/1.1" 204 0
2025-12-01 19:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA19YRV/2025-12-01/image/2201c716-4048-4559-b8f5-7cd42535a183_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117621114?view=catalogue)
2025-12-01 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 117590147
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117590147%27 HTTP/1.1" 200 None
2025-12-01 19:00:29 [astonbarclay.gb] INFO: Scrape type for 117590147: 0
2025-12-01 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 117590106
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117590106%27 HTTP/1.1" 200 None
2025-12-01 19:00:29 [astonbarclay.gb] INFO: Scrape type for 117590106: 0
2025-12-01 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 117592979
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117592979%27 HTTP/1.1" 200 None
2025-12-01 19:00:29 [astonbarclay.gb] INFO: Scrape type for 117592979: 1
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDE17YWV%252F2025-12-01%252Fimage%252Fc78ece7c-8885-46ad-ad9f-c930ca8c36cf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE17YWV/2025-12-01/image/c78ece7c-8885-46ad-ad9f-c930ca8c36cf_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYR66YCG%252F2025-12-01%252Fimage%252Fafda7eb8-81b8-4f72-bed3-c7f8c206c83a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR66YCG/2025-12-01/image/afda7eb8-81b8-4f72-bed3-c7f8c206c83a_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWL19RLV%252F2025-12-01%252Fimage%252F4bcfea0b-3877-4b2b-911d-d7813da4fcd9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WL19RLV/2025-12-01/image/4bcfea0b-3877-4b2b-911d-d7813da4fcd9_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA19YRV%252F2025-12-01%252Fimage%252F6bbaf1fb-75ea-4a14-b4ed-06bf0498a82f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19YRV/2025-12-01/image/6bbaf1fb-75ea-4a14-b4ed-06bf0498a82f_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117491510, 'registration': 'MM66UMT', 'account': 'THE109', 'make': 'VOLKSWAGEN', 'model': 'TIGUAN DIESEL ESTATE', 'derivative': '2.0 TDi 150 4Motion SE Nav 5dr', 'mileage': 88338, 'mileageWarranty': True, 'type': 'car', 'saleId': 17896, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-02T13:00Z', 'lot': 79, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-12-21', 'fuel': 'Diesel', 'motExpiry': '2026-12-20', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print and book 01/18 - 10K, 21K - NO DATE, 10/19 - 32K, 11/20 - 41K, 11/21 - 52K, 12/22 - 59K, 12/23 - 69K, 02/23 - 79K, 11/25 - 88K - REPLACED TIMING BELT AND WATER PUMP', 'remarks': '**522** VOSA STATES 34K, 41K, 52K, 59K, 69K, 79K, 88K SD CARD', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/124fa5e6-d6ee-44d3-8f1a-b2403a3ba9de.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117491510, 'registration': 'MM66UMT', 'account': 'THE109', 'make': 'VOLKSWAGEN', 'model': 'TIGUAN DIESEL ESTATE', 'derivative': '2.0 TDi 150 4Motion SE Nav 5dr', 'mileage': 88338, 'mileageWarranty': True, 'type': 'car', 'saleId': 17896, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-02T13:00Z', 'lot': 79, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-12-21', 'fuel': 'Diesel', 'motExpiry': '2026-12-20', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print and book 01/18 - 10K, 21K - NO DATE, 10/19 - 32K, 11/20 - 41K, 11/21 - 52K, 12/22 - 59K, 12/23 - 69K, 02/23 - 79K, 11/25 - 88K - REPLACED TIMING BELT AND WATER PUMP', 'remarks': '**522** VOSA STATES 34K, 41K, 52K, 59K, 69K, 79K, 88K SD CARD', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/124fa5e6-d6ee-44d3-8f1a-b2403a3ba9de.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79e97e1a-3ce0-546f-9ce2-f3d1d9a6c77e with identifier: 117491510
2025-12-01 19:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79e97e1a-3ce0-546f-9ce2-f3d1d9a6c77e with scrape type 1
2025-12-01 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 79e97e1a-3ce0-546f-9ce2-f3d1d9a6c77e
2025-12-01 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 79e97e1a-3ce0-546f-9ce2-f3d1d9a6c77e
2025-12-01 19:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 79e97e1a-3ce0-546f-9ce2-f3d1d9a6c77e, identifier: 117491510
2025-12-01 19:00:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117585284, 'registration': 'NY68VHB', 'account': 'DJC008', 'make': 'MITSUBISHI', 'model': 'ECLIPSE CROSS HATCHBACK', 'derivative': '1.5 4 5dr CVT 4WD', 'mileage': 165837, 'mileageWarranty': True, 'type': 'car', 'saleId': 17897, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-02T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-01-31', 'fuel': 'Petrol', 'motExpiry': '2026-02-10', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 08/23 - 65K, 01/24 - 76K', 'remarks': '**1474** VOSA STATES 33K, 49K, 76K, 123K', 'virtual': False, 'seller': 'Cox Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 175, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117585284, 'registration': 'NY68VHB', 'account': 'DJC008', 'make': 'MITSUBISHI', 'model': 'ECLIPSE CROSS HATCHBACK', 'derivative': '1.5 4 5dr CVT 4WD', 'mileage': 165837, 'mileageWarranty': True, 'type': 'car', 'saleId': 17897, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-02T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-01-31', 'fuel': 'Petrol', 'motExpiry': '2026-02-10', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 08/23 - 65K, 01/24 - 76K', 'remarks': '**1474** VOSA STATES 33K, 49K, 76K, 123K', 'virtual': False, 'seller': 'Cox Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 175, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9f5ef9c-0327-5025-bc2b-1a9d6fe4ed3e with identifier: 117585284
2025-12-01 19:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9f5ef9c-0327-5025-bc2b-1a9d6fe4ed3e with scrape type 1
2025-12-01 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item b9f5ef9c-0327-5025-bc2b-1a9d6fe4ed3e
2025-12-01 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item b9f5ef9c-0327-5025-bc2b-1a9d6fe4ed3e
2025-12-01 19:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b9f5ef9c-0327-5025-bc2b-1a9d6fe4ed3e, identifier: 117585284
2025-12-01 19:00:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117573720, 'registration': 'BV18ZZA', 'account': 'MOT075', 'make': 'LAND ROVER', 'model': 'RANGE ROVER SPORT ESTATE', 'derivative': '5.0 V8 S/C 575 SVR 5dr Auto', 'mileage': 54531, 'mileageWarranty': True, 'type': 'car', 'saleId': 17896, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-02T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-07-27', 'fuel': 'Petrol', 'motExpiry': '2025-10-28', 'doors': 5, 'engineSize': 4999, 'bodyType': 'Estate', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 25K, 38K, 48K, 52K,', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 294, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117573720, 'registration': 'BV18ZZA', 'account': 'MOT075', 'make': 'LAND ROVER', 'model': 'RANGE ROVER SPORT ESTATE', 'derivative': '5.0 V8 S/C 575 SVR 5dr Auto', 'mileage': 54531, 'mileageWarranty': True, 'type': 'car', 'saleId': 17896, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-02T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-07-27', 'fuel': 'Petrol', 'motExpiry': '2025-10-28', 'doors': 5, 'engineSize': 4999, 'bodyType': 'Estate', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 25K, 38K, 48K, 52K,', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 294, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc849c95-50b6-5e2f-aa48-692b52a6b3c9 with identifier: 117573720
2025-12-01 19:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc849c95-50b6-5e2f-aa48-692b52a6b3c9 with scrape type 1
2025-12-01 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item fc849c95-50b6-5e2f-aa48-692b52a6b3c9
2025-12-01 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item fc849c95-50b6-5e2f-aa48-692b52a6b3c9
2025-12-01 19:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: fc849c95-50b6-5e2f-aa48-692b52a6b3c9, identifier: 117573720
2025-12-01 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 117507396
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507396%27 HTTP/1.1" 200 None
2025-12-01 19:00:29 [astonbarclay.gb] INFO: Scrape type for 117507396: 0
2025-12-01 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 117549150
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549150%27 HTTP/1.1" 200 None
2025-12-01 19:00:29 [astonbarclay.gb] INFO: Scrape type for 117549150: 1
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDE17YWV%252F2025-12-01%252Fimage%252F983b7f49-2ec0-4f09-88d7-6da5e9dd26d8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE17YWV/2025-12-01/image/983b7f49-2ec0-4f09-88d7-6da5e9dd26d8_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYR66YCG%252F2025-12-01%252Fimage%252Fd6c3dea5-047b-443e-8428-99ebeb8bbe36_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR66YCG/2025-12-01/image/d6c3dea5-047b-443e-8428-99ebeb8bbe36_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117585302?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 79e97e1a-3ce0-546f-9ce2-f3d1d9a6c77e with identifier: 117491510
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=WHITE HTTP/1.1" 200 None
2025-12-01 19:00:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-01 19:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-01 19:00:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel HTTP/1.1" 200 None
2025-12-01 19:00:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-01 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-01 19:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 79e97e1a-3ce0-546f-9ce2-f3d1d9a6c77e with identifier: 117491510
2025-12-01 19:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 79e97e1a-3ce0-546f-9ce2-f3d1d9a6c77e with identifier: 117491510 to the API
2025-12-01 19:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:00:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2779e97e1a-3ce0-546f-9ce2-f3d1d9a6c77e%27 HTTP/1.1" 200 None
2025-12-01 19:00:30 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 79e97e1a-3ce0-546f-9ce2-f3d1d9a6c77e: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:00:29 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117491510?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-02T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '79e97e1a-3ce0-546f-9ce2-f3d1d9a6c77e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MM66UMT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117491510',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN DIESEL ESTATE',
 'odometer': 88338,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-21',
 'seller_name': 'TCB Group - Prime',
 'title': 'VOLKSWAGEN TIGUAN DIESEL ESTATE 2.0 TDi 150 4Motion SE Nav 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDi 150 4Motion SE Nav 5dr',
 'vin': None,
 'year': 2016}
2025-12-01 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117491510%27 HTTP/1.1" 200 None
2025-12-01 19:00:30 [astonbarclay.gb] INFO: Saving data for 117491510: {'created_time': 1764615630.403597, 'last_price_update_time': 1764615630.403609, 'auction_closing_time': 1764680400.0}
2025-12-01 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117491510') HTTP/1.1" 204 0
2025-12-01 19:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b9f5ef9c-0327-5025-bc2b-1a9d6fe4ed3e with identifier: 117585284
2025-12-01 19:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-01 19:00:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=SILVER HTTP/1.1" 200 None
2025-12-01 19:00:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-01 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-01 19:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-01 19:00:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol HTTP/1.1" 200 None
2025-12-01 19:00:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-01 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-01 19:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b9f5ef9c-0327-5025-bc2b-1a9d6fe4ed3e with identifier: 117585284
2025-12-01 19:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': 'cox motor group', 'price_includes_vat': False, 'title': 'mitsubishi eclipse cross hatchback 1.5 4 5dr cvt 4wd', 'price': 0, 'currency': 'gbp', 'make': 'mitsubishi', 'model': 'eclipse cross hatchback', 'transmission': 'automatic', 'engine': '1.5l', 'fuel_type': 'petrol', 'odometer': 165837, 'odometer_reading_unit': 'mi', 'registration_date': '2019-01-31', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117585284', 'expiration_date': '2025-12-02t13:00:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '1.5 4 5dr cvt 4wd', 'license_plate': 'ny68vhb', 'year': 2019, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 175, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'b9f5ef9c-0327-5025-bc2b-1a9d6fe4ed3e', 'current_year_diff': 6, 'age_in_months': 82, 'make_model': 'mitsubishi eclipse cross hatchback', 'sanitized_make': 'mitsubishi', 'odometer_in_km': 266888}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 82,
     'auction_title': '',
     'c_o_2_emission_value': 175,
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.5l',
     'expiration_date': '2025-12-02t13:00:00z',
     'fuel_type': 'petrol',
     'id': 'b9f5ef9c-0327-5025-bc2b-1a9d6fe4ed3e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'ny68vhb',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117585284',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'mitsubishi',
     'make_model': 'mitsubishi eclipse cross hatchback',
     'model': 'eclipse cross hatchback',
     'odometer': 165837,
     'odometer_in_km': 266888,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-01-31',
     'sanitized_make': 'mitsubishi',
     'seller_name': 'cox motor group',
     'title': 'mitsubishi eclipse cross hatchback 1.5 4 5dr cvt 4wd',
     'transmission': 'automatic',
     'trim': '1.5 4 5dr cvt 4wd',
     'vin': None,
     'year': 2019}
2025-12-01 19:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: b9f5ef9c-0327-5025-bc2b-1a9d6fe4ed3e spider: astonbarclay.gb
2025-12-01 19:00:30 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: b9f5ef9c-0327-5025-bc2b-1a9d6fe4ed3e due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': 'cox motor group', 'price_includes_vat': False, 'title': 'mitsubishi eclipse cross hatchback 1.5 4 5dr cvt 4wd', 'price': 0, 'currency': 'gbp', 'make': 'mitsubishi', 'model': 'eclipse cross hatchback', 'transmission': 'automatic', 'engine': '1.5l', 'fuel_type': 'petrol', 'odometer': 165837, 'odometer_reading_unit': 'mi', 'registration_date': '2019-01-31', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117585284', 'expiration_date': '2025-12-02t13:00:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '1.5 4 5dr cvt 4wd', 'license_plate': 'ny68vhb', 'year': 2019, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 175, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'b9f5ef9c-0327-5025-bc2b-1a9d6fe4ed3e', 'current_year_diff': 6, 'age_in_months': 82, 'make_model': 'mitsubishi eclipse cross hatchback', 'sanitized_make': 'mitsubishi', 'odometer_in_km': 266888}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 82,
     'auction_title': '',
     'c_o_2_emission_value': 175,
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.5l',
     'expiration_date': '2025-12-02t13:00:00z',
     'fuel_type': 'petrol',
     'id': 'b9f5ef9c-0327-5025-bc2b-1a9d6fe4ed3e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'ny68vhb',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117585284',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'mitsubishi',
     'make_model': 'mitsubishi eclipse cross hatchback',
     'model': 'eclipse cross hatchback',
     'odometer': 165837,
     'odometer_in_km': 266888,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-01-31',
     'sanitized_make': 'mitsubishi',
     'seller_name': 'cox motor group',
     'title': 'mitsubishi eclipse cross hatchback 1.5 4 5dr cvt 4wd',
     'transmission': 'automatic',
     'trim': '1.5 4 5dr cvt 4wd',
     'vin': None,
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-02T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'b9f5ef9c-0327-5025-bc2b-1a9d6fe4ed3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NY68VHB',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117585284',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MITSUBISHI',
 'model': 'ECLIPSE CROSS HATCHBACK',
 'odometer': 165837,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-31',
 'seller_name': 'Cox Motor Group',
 'title': 'MITSUBISHI ECLIPSE CROSS HATCHBACK 1.5 4 5dr CVT 4WD',
 'transmission': 'automatic',
 'trim': '1.5 4 5dr CVT 4WD',
 'vin': None,
 'year': 2019}
2025-12-01 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585284%27 HTTP/1.1" 200 None
2025-12-01 19:00:30 [astonbarclay.gb] INFO: Saving data for 117585284: {'created_time': 1764615630.876802, 'last_price_update_time': 1764615630.876814, 'auction_closing_time': 1764680400.0}
2025-12-01 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117585284') HTTP/1.1" 204 0
2025-12-01 19:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: fc849c95-50b6-5e2f-aa48-692b52a6b3c9 with identifier: 117573720
2025-12-01 19:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-01 19:00:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLUE HTTP/1.1" 200 None
2025-12-01 19:00:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-01 19:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: fc849c95-50b6-5e2f-aa48-692b52a6b3c9 with identifier: 117573720
2025-12-01 19:00:31 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: fc849c95-50b6-5e2f-aa48-692b52a6b3c9 with identifier: 117573720 to the API
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27fc849c95-50b6-5e2f-aa48-692b52a6b3c9%27 HTTP/1.1" 200 None
2025-12-01 19:00:31 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id fc849c95-50b6-5e2f-aa48-692b52a6b3c9: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:00:30 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:00:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117573720?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 294,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '5.0L',
 'expiration_date': '2025-12-02T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'fc849c95-50b6-5e2f-aa48-692b52a6b3c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BV18ZZA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117573720',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER SPORT ESTATE',
 'odometer': 54531,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-27',
 'seller_name': 'MotoNovo Finance',
 'title': 'LAND ROVER RANGE ROVER SPORT ESTATE 5.0 V8 S/C 575 SVR 5dr Auto',
 'transmission': 'automatic',
 'trim': '5.0 V8 S/C 575 SVR 5dr Auto',
 'vin': None,
 'year': 2018}
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573720%27 HTTP/1.1" 200 None
2025-12-01 19:00:31 [astonbarclay.gb] INFO: Saving data for 117573720: {'created_time': 1764615631.453846, 'last_price_update_time': 1764615631.453856, 'auction_closing_time': 1764680400.0}
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117573720') HTTP/1.1" 204 0
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWL19RLV%252F2025-12-01%252Fimage%252F61489502-b40d-4f40-95bf-8b4d75a802d2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WL19RLV/2025-12-01/image/61489502-b40d-4f40-95bf-8b4d75a802d2_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA19YRV%252F2025-12-01%252Fimage%252Fb99607bd-63b7-4065-a0c5-dda5e31dee44_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19YRV/2025-12-01/image/b99607bd-63b7-4065-a0c5-dda5e31dee44_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YR66YCG/2025-12-01/image/cc49f354-c540-4000-bb15-d5dc11dc8098_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117609015?view=catalogue)
2025-12-01 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117570189
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570189%27 HTTP/1.1" 200 None
2025-12-01 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117570189: 0
2025-12-01 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117553434
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117553434%27 HTTP/1.1" 200 None
2025-12-01 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117553434: 0
2025-12-01 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 116988307
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116988307%27 HTTP/1.1" 200 None
2025-12-01 19:00:31 [astonbarclay.gb] INFO: Scrape type for 116988307: 0
2025-12-01 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117609158
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117609158%27 HTTP/1.1" 200 None
2025-12-01 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117609158: 0
2025-12-01 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117583554
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117583554%27 HTTP/1.1" 200 None
2025-12-01 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117583554: 1
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDE17YWV%252F2025-12-01%252Fimage%252F43ceb04c-2be2-45c9-bdd8-7e129924f0b1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE17YWV/2025-12-01/image/43ceb04c-2be2-45c9-bdd8-7e129924f0b1_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYR66YCG%252F2025-12-01%252Fimage%252F63f13649-bbea-4df9-bd58-9089925d3ae6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR66YCG/2025-12-01/image/63f13649-bbea-4df9-bd58-9089925d3ae6_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWL19RLV%252F2025-12-01%252Fimage%252Fca6a3055-4e9c-42b6-93e6-7a8bb1e6056e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WL19RLV/2025-12-01/image/ca6a3055-4e9c-42b6-93e6-7a8bb1e6056e_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA19YRV%252F2025-12-01%252Fimage%252F37233342-b6c1-4aae-9ee9-2ffe6be1a099_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19YRV/2025-12-01/image/37233342-b6c1-4aae-9ee9-2ffe6be1a099_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117051310?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e85b1d0>
2025-12-01 19:00:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89214aa6-43de-5869-9911-0711c93784fc/89214aa6-43de-5869-9911-0711c93784fc_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA19YRV%252F2025-12-01%252Fimage%252F2201c716-4048-4559-b8f5-7cd42535a183_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19YRV/2025-12-01/image/2201c716-4048-4559-b8f5-7cd42535a183_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 89214aa6-43de-5869-9911-0711c93784fc
2025-12-01 19:00:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117585302, 'registration': 'MK66YOH', 'account': 'DJC008', 'make': 'NISSAN', 'model': 'X-TRAIL DIESEL STATION WAGON', 'derivative': '1.6 dCi N-Vision 5dr', 'mileage': 105048, 'mileageWarranty': True, 'type': 'car', 'saleId': 17897, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-02T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-12-20', 'fuel': 'Diesel', 'motExpiry': '2025-12-20', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service book 12/17 - 15K, 01/19 - 28K, 12/19 - 36K, 12/20 - 49K, 12/21 - 62K, 02/25 - 95K', 'remarks': '**1697** VOSA STATES 36K, 49K, 62K, 69K, 81K, 93K', 'virtual': False, 'seller': 'Cox Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117585302, 'registration': 'MK66YOH', 'account': 'DJC008', 'make': 'NISSAN', 'model': 'X-TRAIL DIESEL STATION WAGON', 'derivative': '1.6 dCi N-Vision 5dr', 'mileage': 105048, 'mileageWarranty': True, 'type': 'car', 'saleId': 17897, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-02T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-12-20', 'fuel': 'Diesel', 'motExpiry': '2025-12-20', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service book 12/17 - 15K, 01/19 - 28K, 12/19 - 36K, 12/20 - 49K, 12/21 - 62K, 02/25 - 95K', 'remarks': '**1697** VOSA STATES 36K, 49K, 62K, 69K, 81K, 93K', 'virtual': False, 'seller': 'Cox Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 650c6e7e-1b8c-5a96-bc6b-ac9ada4a3463 with identifier: 117585302
2025-12-01 19:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 650c6e7e-1b8c-5a96-bc6b-ac9ada4a3463 with scrape type 1
2025-12-01 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 650c6e7e-1b8c-5a96-bc6b-ac9ada4a3463
2025-12-01 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 650c6e7e-1b8c-5a96-bc6b-ac9ada4a3463
2025-12-01 19:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 650c6e7e-1b8c-5a96-bc6b-ac9ada4a3463, identifier: 117585302
2025-12-01 19:00:32 [astonbarclay.gb] INFO: Found listing with ID: 117386686
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117386686%27 HTTP/1.1" 200 None
2025-12-01 19:00:32 [astonbarclay.gb] INFO: Scrape type for 117386686: 0
2025-12-01 19:00:32 [astonbarclay.gb] INFO: Found listing with ID: 117609197
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117609197%27 HTTP/1.1" 200 None
2025-12-01 19:00:32 [astonbarclay.gb] INFO: Scrape type for 117609197: 0
2025-12-01 19:00:32 [astonbarclay.gb] INFO: Found listing with ID: 116859641
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116859641%27 HTTP/1.1" 200 None
2025-12-01 19:00:32 [astonbarclay.gb] INFO: Scrape type for 116859641: 0
2025-12-01 19:00:32 [astonbarclay.gb] INFO: Found listing with ID: 117334306
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117334306%27 HTTP/1.1" 200 None
2025-12-01 19:00:32 [astonbarclay.gb] INFO: Scrape type for 117334306: 0
2025-12-01 19:00:32 [astonbarclay.gb] INFO: Found listing with ID: 117495142
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117495142%27 HTTP/1.1" 200 None
2025-12-01 19:00:32 [astonbarclay.gb] INFO: Scrape type for 117495142: 1
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDE17YWV%252F2025-12-01%252Fimage%252Fcd7be7de-093c-4c2d-a0f6-104567d25a66_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE17YWV/2025-12-01/image/cd7be7de-093c-4c2d-a0f6-104567d25a66_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYR66YCG%252F2025-12-01%252Fimage%252Fc5931db0-1018-4af3-830a-5cb191d14c39_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR66YCG/2025-12-01/image/c5931db0-1018-4af3-830a-5cb191d14c39_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 650c6e7e-1b8c-5a96-bc6b-ac9ada4a3463 with identifier: 117585302
2025-12-01 19:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 650c6e7e-1b8c-5a96-bc6b-ac9ada4a3463 with identifier: 117585302
2025-12-01 19:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 169057 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169057
2025-12-01 19:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 650c6e7e-1b8c-5a96-bc6b-ac9ada4a3463 spider: astonbarclay.gb
2025-12-01 19:00:32 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 650c6e7e-1b8c-5a96-bc6b-ac9ada4a3463 due to rule: high_mileage_for_country.json, error: 169057 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169057
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-02T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '650c6e7e-1b8c-5a96-bc6b-ac9ada4a3463',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MK66YOH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117585302',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'NISSAN',
 'model': 'X-TRAIL DIESEL STATION WAGON',
 'odometer': 105048,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-20',
 'seller_name': 'Cox Motor Group',
 'title': 'NISSAN X-TRAIL DIESEL STATION WAGON 1.6 dCi N-Vision 5dr',
 'transmission': 'manual',
 'trim': '1.6 dCi N-Vision 5dr',
 'vin': None,
 'year': 2016}
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585302%27 HTTP/1.1" 200 None
2025-12-01 19:00:32 [astonbarclay.gb] INFO: Saving data for 117585302: {'created_time': 1764615632.327101, 'last_price_update_time': 1764615632.327112, 'auction_closing_time': 1764680400.0}
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117585302') HTTP/1.1" 204 0
2025-12-01 19:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WL19RLV/2025-12-01/image/d2a24375-171e-4501-8a81-8a55efa8c542_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117632563?view=catalogue)
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA19YRV%252F2025-12-01%252Fimage%252Fa8860e8a-3fb3-4c6e-93b3-dabae7aef4b9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19YRV/2025-12-01/image/a8860e8a-3fb3-4c6e-93b3-dabae7aef4b9_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e844f50>
2025-12-01 19:00:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_806e8254-da45-58a2-9827-dc16cca75b5c/806e8254-da45-58a2-9827-dc16cca75b5c_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYR66YCG%252F2025-12-01%252Fimage%252Fcc49f354-c540-4000-bb15-d5dc11dc8098_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR66YCG/2025-12-01/image/cc49f354-c540-4000-bb15-d5dc11dc8098_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 806e8254-da45-58a2-9827-dc16cca75b5c
2025-12-01 19:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YR66YCG/2025-12-01/image/d6c3dea5-047b-443e-8428-99ebeb8bbe36_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117609015?view=catalogue)
2025-12-01 19:00:32 [astonbarclay.gb] INFO: Found listing with ID: 117581566
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117581566%27 HTTP/1.1" 200 None
2025-12-01 19:00:32 [astonbarclay.gb] INFO: Scrape type for 117581566: 0
2025-12-01 19:00:32 [astonbarclay.gb] INFO: Found listing with ID: 117595959
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117595959%27 HTTP/1.1" 200 None
2025-12-01 19:00:32 [astonbarclay.gb] INFO: Scrape type for 117595959: 0
2025-12-01 19:00:32 [astonbarclay.gb] INFO: Found listing with ID: 117596913
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117596913%27 HTTP/1.1" 200 None
2025-12-01 19:00:32 [astonbarclay.gb] INFO: Scrape type for 117596913: 1
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDE17YWV%252F2025-12-01%252Fimage%252Fceac24e4-53c0-48f2-be99-91fb0dc82a3b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE17YWV/2025-12-01/image/ceac24e4-53c0-48f2-be99-91fb0dc82a3b_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYR66YCG%252F2025-12-01%252Fimage%252Fc7105256-bcd1-4d20-8846-5f0fe0d1d477_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR66YCG/2025-12-01/image/c7105256-bcd1-4d20-8846-5f0fe0d1d477_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117051310, 'registration': 'LB66ZGG', 'account': 'WIL004', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK SPECIAL EDS', 'derivative': '1.4 [75] ecoFLEX Energy 3dr [AC]', 'mileage': 36775, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-02-22', 'fuel': 'Petrol', 'motExpiry': '2026-02-21', 'doors': 3, 'engineSize': 1398, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/39df14a8-3e2d-498f-a00f-05a539eb850e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/7aed7243-7584-48a8-ab97-2eb7a25e85ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/656760e6-776b-4806-89ce-3cee0405d42f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/ff12a178-e830-491a-9746-cd7aa900c4d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/58ed45d7-1526-43c8-80f7-26a2156a6271_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/feb5e820-8533-417a-a971-cc202187cdbd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/bf264d2b-3050-4647-a7d9-7361fe95e655_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/ef4048e4-beef-482b-b0e8-33484292591e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/06bf0ca3-110b-4bbd-945e-6d301a514088_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book 02/18 5K 01/19 12K 03/20 19K 03/21 24K 03/22 27K INV @ 03/23 29K 02/24 32K 03/25 35K', 'remarks': 'NO SPARE KEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/00ea978e-c8bf-4ca7-8863-5f5618f574a9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117051310, 'registration': 'LB66ZGG', 'account': 'WIL004', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK SPECIAL EDS', 'derivative': '1.4 [75] ecoFLEX Energy 3dr [AC]', 'mileage': 36775, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-02-22', 'fuel': 'Petrol', 'motExpiry': '2026-02-21', 'doors': 3, 'engineSize': 1398, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/39df14a8-3e2d-498f-a00f-05a539eb850e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/7aed7243-7584-48a8-ab97-2eb7a25e85ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/656760e6-776b-4806-89ce-3cee0405d42f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/ff12a178-e830-491a-9746-cd7aa900c4d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/58ed45d7-1526-43c8-80f7-26a2156a6271_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/feb5e820-8533-417a-a971-cc202187cdbd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/bf264d2b-3050-4647-a7d9-7361fe95e655_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/ef4048e4-beef-482b-b0e8-33484292591e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66ZGG/2025-11-13/image/06bf0ca3-110b-4bbd-945e-6d301a514088_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book 02/18 5K 01/19 12K 03/20 19K 03/21 24K 03/22 27K INV @ 03/23 29K 02/24 32K 03/25 35K', 'remarks': 'NO SPARE KEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/00ea978e-c8bf-4ca7-8863-5f5618f574a9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d4d498d-9c16-52cc-8328-f18328382bce with identifier: 117051310
2025-12-01 19:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d4d498d-9c16-52cc-8328-f18328382bce with scrape type 2
2025-12-01 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d4d498d-9c16-52cc-8328-f18328382bce with scrape type 2
2025-12-01 19:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5d4d498d-9c16-52cc-8328-f18328382bce, identifier: 117051310
2025-12-01 19:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117243027?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117635994?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117131550?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117123611?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117243071?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117175584?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5d4d498d-9c16-52cc-8328-f18328382bce with identifier: 117051310
2025-12-01 19:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5d4d498d-9c16-52cc-8328-f18328382bce with identifier: 117051310
2025-12-01 19:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5d4d498d-9c16-52cc-8328-f18328382bce with identifier: 117051310 to the API
2025-12-01 19:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%275d4d498d-9c16-52cc-8328-f18328382bce%27 HTTP/1.1" 200 None
2025-12-01 19:00:33 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 5d4d498d-9c16-52cc-8328-f18328382bce: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:00:32 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117051310?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '5d4d498d-9c16-52cc-8328-f18328382bce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LB66ZGG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117051310',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'VAUXHALL',
 'model': 'CORSA HATCHBACK SPECIAL EDS',
 'odometer': 36775,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-22',
 'seller_name': 'Wilsons',
 'title': 'VAUXHALL CORSA HATCHBACK SPECIAL EDS 1.4 [75] ecoFLEX Energy 3dr '
          '[AC]',
 'transmission': 'manual',
 'trim': '1.4 [75] ecoFLEX Energy 3dr [AC]',
 'vin': None,
 'year': 2017}
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117051310%27 HTTP/1.1" 200 None
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Saving data for 117051310: {'auction_closing_time': 1764755100.0, 'created_time': 1762938049.172648, 'last_price_update_time': 1764615633.172028}
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117051310') HTTP/1.1" 204 0
2025-12-01 19:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA19YRV/2025-12-01/image/4a1c666f-01a8-405c-9dc2-d49f862447aa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117621114?view=catalogue)
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 116409684
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116409684%27 HTTP/1.1" 200 None
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Scrape type for 116409684: 0
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117420774
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117420774%27 HTTP/1.1" 200 None
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117420774: 0
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117331028
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117331028%27 HTTP/1.1" 200 None
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117331028: 0
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117413519
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117413519%27 HTTP/1.1" 200 None
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117413519: 0
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117420120
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117420120%27 HTTP/1.1" 200 None
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117420120: 0
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117376148
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117376148%27 HTTP/1.1" 200 None
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117376148: 0
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117424938
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117424938%27 HTTP/1.1" 200 None
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117424938: 0
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117426088
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117426088%27 HTTP/1.1" 200 None
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117426088: 0
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117433308
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117433308%27 HTTP/1.1" 200 None
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117433308: 0
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117431352
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117431352%27 HTTP/1.1" 200 None
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117431352: 0
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117461867
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117461867%27 HTTP/1.1" 200 None
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117461867: 0
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117450382
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117450382%27 HTTP/1.1" 200 None
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117450382: 0
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117451351
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117451351%27 HTTP/1.1" 200 None
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117451351: 0
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117487536
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117487536%27 HTTP/1.1" 200 None
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117487536: 0
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117489004
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117489004%27 HTTP/1.1" 200 None
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117489004: 0
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117567379
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117567379%27 HTTP/1.1" 200 None
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117567379: 0
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117509153
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117509153%27 HTTP/1.1" 200 None
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117509153: 0
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117539515
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117539515%27 HTTP/1.1" 200 None
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117539515: 0
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117541958
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117541958%27 HTTP/1.1" 200 None
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117541958: 0
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117563502
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117563502%27 HTTP/1.1" 200 None
2025-12-01 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117563502: 1
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDE17YWV%252F2025-12-01%252Fimage%252Ff1b9b5b3-b66a-409c-8624-6d465ff90acf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE17YWV/2025-12-01/image/f1b9b5b3-b66a-409c-8624-6d465ff90acf_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYR66YCG%252F2025-12-01%252Fimage%252F1416b83a-0a0d-4e37-b01d-8a7e38bc0040_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR66YCG/2025-12-01/image/1416b83a-0a0d-4e37-b01d-8a7e38bc0040_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e837550>
2025-12-01 19:00:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315a462f-b1fb-5767-99b3-d3e45f95653b/315a462f-b1fb-5767-99b3-d3e45f95653b_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWL19RLV%252F2025-12-01%252Fimage%252Fd2a24375-171e-4501-8a81-8a55efa8c542_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WL19RLV/2025-12-01/image/d2a24375-171e-4501-8a81-8a55efa8c542_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 315a462f-b1fb-5767-99b3-d3e45f95653b
2025-12-01 19:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA19YRV/2025-12-01/image/37233342-b6c1-4aae-9ee9-2ffe6be1a099_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117621114?view=catalogue)
2025-12-01 19:00:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e8e9250>
2025-12-01 19:00:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_806e8254-da45-58a2-9827-dc16cca75b5c/806e8254-da45-58a2-9827-dc16cca75b5c_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYR66YCG%252F2025-12-01%252Fimage%252Fd6c3dea5-047b-443e-8428-99ebeb8bbe36_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR66YCG/2025-12-01/image/d6c3dea5-047b-443e-8428-99ebeb8bbe36_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 806e8254-da45-58a2-9827-dc16cca75b5c
2025-12-01 19:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YR66YCG/2025-12-01/image/c5931db0-1018-4af3-830a-5cb191d14c39_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117609015?view=catalogue)
2025-12-01 19:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA19YRV/2025-12-01/image/c4ec43eb-d5cb-456b-aee2-a3ffe38f099f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117621114?view=catalogue)
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117558544
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117558544%27 HTTP/1.1" 200 None
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117558544: 0
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117557140
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117557140%27 HTTP/1.1" 200 None
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117557140: 0
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117525337
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117525337%27 HTTP/1.1" 200 None
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117525337: 0
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117549056
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549056%27 HTTP/1.1" 200 None
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117549056: 0
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117512026
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117512026%27 HTTP/1.1" 200 None
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117512026: 0
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117458458
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117458458%27 HTTP/1.1" 200 None
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117458458: 0
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117422977
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117422977%27 HTTP/1.1" 200 None
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117422977: 0
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117488596
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117488596%27 HTTP/1.1" 200 None
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117488596: 0
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117536984
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117536984%27 HTTP/1.1" 200 None
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117536984: 0
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117542492
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117542492%27 HTTP/1.1" 200 None
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117542492: 0
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117549984
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549984%27 HTTP/1.1" 200 None
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117549984: 0
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117573652
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573652%27 HTTP/1.1" 200 None
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117573652: 0
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117522663
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117522663%27 HTTP/1.1" 200 None
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117522663: 0
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117543631
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117543631%27 HTTP/1.1" 200 None
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117543631: 0
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117488496
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117488496%27 HTTP/1.1" 200 None
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117488496: 0
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117498338
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498338%27 HTTP/1.1" 200 None
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117498338: 0
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117539643
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117539643%27 HTTP/1.1" 200 None
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117539643: 0
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117561133
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117561133%27 HTTP/1.1" 200 None
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117561133: 0
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117543930
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117543930%27 HTTP/1.1" 200 None
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117543930: 0
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117492284
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117492284%27 HTTP/1.1" 200 None
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117492284: 0
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117486262
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117486262%27 HTTP/1.1" 200 None
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117486262: 0
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117552056
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117552056%27 HTTP/1.1" 200 None
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117552056: 0
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117552007
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117552007%27 HTTP/1.1" 200 None
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117552007: 0
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117351302
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117351302%27 HTTP/1.1" 200 None
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117351302: 0
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117484807
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117484807%27 HTTP/1.1" 200 None
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117484807: 0
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117397605
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117397605%27 HTTP/1.1" 200 None
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117397605: 2
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDE17YWV%252F2025-12-01%252Fimage%252F67195d9c-b82b-45ce-b970-38ec4af90eae_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE17YWV/2025-12-01/image/67195d9c-b82b-45ce-b970-38ec4af90eae_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYR66YCG%252F2025-12-01%252Fimage%252F0c12bf38-d294-4916-af8c-afb2632f1339_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR66YCG/2025-12-01/image/0c12bf38-d294-4916-af8c-afb2632f1339_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117243027, 'registration': 'HS16KYR', 'account': 'WIL004', 'make': 'RENAULT', 'model': 'CAPTUR DIESEL HATCHBACK', 'derivative': '1.5 dCi 90 Signature Nav 5dr Auto', 'mileage': 61234, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-07-28', 'fuel': 'Diesel', 'motExpiry': '2026-07-28', 'doors': 5, 'engineSize': 1461, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HS16KYR/2025-11-20/image/f15eb871-0801-4f66-b181-9b260e51db93_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/01887831-45c6-4178-9164-8efb783fab0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/2c17fcf4-ace5-4e73-8b23-af70f6006b76_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/1ad74979-4ca0-425b-b24f-f05fc95ae52a_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/af417018-fb12-48eb-89ea-ece2e5a0256b_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/bfacb41e-26fd-4bff-987a-dbeaa34fb947_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/84f5d3e7-a6a0-448f-b4d8-6bab035f585c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/47bc54f0-8c82-487a-b602-d4c50d4356ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/0a404ab4-3aed-40db-9fc1-8fb0bc8ae68b_removebg.jpg?w=600'], 'colour': 'RED/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 07/17 10K 07/17 15K (SB ERROR) 07/19 20K 07/20 26K 07/21 33K 07/22 41K 07/23 47K 07/24 53K 06/25 59K', 'remarks': 'SD CARD / NO SPARE KEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/214a2f49-f4a1-4549-b578-b086b6a9a118.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117243027, 'registration': 'HS16KYR', 'account': 'WIL004', 'make': 'RENAULT', 'model': 'CAPTUR DIESEL HATCHBACK', 'derivative': '1.5 dCi 90 Signature Nav 5dr Auto', 'mileage': 61234, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-07-28', 'fuel': 'Diesel', 'motExpiry': '2026-07-28', 'doors': 5, 'engineSize': 1461, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HS16KYR/2025-11-20/image/f15eb871-0801-4f66-b181-9b260e51db93_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/01887831-45c6-4178-9164-8efb783fab0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/2c17fcf4-ace5-4e73-8b23-af70f6006b76_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/1ad74979-4ca0-425b-b24f-f05fc95ae52a_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/af417018-fb12-48eb-89ea-ece2e5a0256b_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/bfacb41e-26fd-4bff-987a-dbeaa34fb947_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/84f5d3e7-a6a0-448f-b4d8-6bab035f585c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/47bc54f0-8c82-487a-b602-d4c50d4356ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16KYR/2025-11-20/image/0a404ab4-3aed-40db-9fc1-8fb0bc8ae68b_removebg.jpg?w=600'], 'colour': 'RED/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 07/17 10K 07/17 15K (SB ERROR) 07/19 20K 07/20 26K 07/21 33K 07/22 41K 07/23 47K 07/24 53K 06/25 59K', 'remarks': 'SD CARD / NO SPARE KEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/214a2f49-f4a1-4549-b578-b086b6a9a118.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 590613a5-74b5-5f62-bf45-ebc1e4651545 with identifier: 117243027
2025-12-01 19:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 590613a5-74b5-5f62-bf45-ebc1e4651545 with scrape type 2
2025-12-01 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 590613a5-74b5-5f62-bf45-ebc1e4651545 with scrape type 2
2025-12-01 19:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 590613a5-74b5-5f62-bf45-ebc1e4651545, identifier: 117243027
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117635994, 'registration': 'CK71ZTU', 'account': 'SOM004', 'make': 'HYUNDAI', 'model': 'IONIQ ELECTRIC HATCHBACK', 'derivative': '100kW Premium 38kWh 5dr Auto', 'mileage': 87845, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-11-02', 'fuel': 'Electric', 'motExpiry': '2026-08-06', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service book BLANK S/P @ 04/22 8K 08/22 19K 01/23 31K 10/23 42K 04/24 54K', 'remarks': 'Ex-Private Hire - S/KEY', 'virtual': False, 'seller': 'Account Lowratecarfinance Ltd t/a Somerset Motor Company', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3b35c7c7-e8ce-45f8-9371-a290158448b9.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117635994, 'registration': 'CK71ZTU', 'account': 'SOM004', 'make': 'HYUNDAI', 'model': 'IONIQ ELECTRIC HATCHBACK', 'derivative': '100kW Premium 38kWh 5dr Auto', 'mileage': 87845, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-11-02', 'fuel': 'Electric', 'motExpiry': '2026-08-06', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service book BLANK S/P @ 04/22 8K 08/22 19K 01/23 31K 10/23 42K 04/24 54K', 'remarks': 'Ex-Private Hire - S/KEY', 'virtual': False, 'seller': 'Account Lowratecarfinance Ltd t/a Somerset Motor Company', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3b35c7c7-e8ce-45f8-9371-a290158448b9.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-01 19:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68718674-16a5-5d6f-aa5f-eef5f6f7ec21 with identifier: 117635994
2025-12-01 19:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68718674-16a5-5d6f-aa5f-eef5f6f7ec21 with scrape type 1
2025-12-01 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 68718674-16a5-5d6f-aa5f-eef5f6f7ec21
2025-12-01 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 68718674-16a5-5d6f-aa5f-eef5f6f7ec21
2025-12-01 19:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 68718674-16a5-5d6f-aa5f-eef5f6f7ec21, identifier: 117635994
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117131550, 'registration': 'BH19XWJ', 'account': 'WIL004', 'make': 'CITROEN', 'model': 'GRAND C4 SPACETOURER ESTATE (RC)', 'derivative': '1.2 PureTech 130 Flair 5dr', 'mileage': 44461, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-08-12', 'fuel': 'Petrol', 'motExpiry': '2026-08-11', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/f4eff252-fb17-4b3c-a49b-431948aaae35_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/f693600e-cd70-4b99-a583-152af9014350_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/cc966adf-816c-4cb4-a223-76af9f6756ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/fb5bb530-683d-4cba-adc5-f4bbc3788d24_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/79430369-61e5-46fc-b127-3f8342c7041c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/5fb27594-c4ef-43c7-9a19-83acc4a28e93_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/98eeb9ce-36b2-456f-9675-a75015b88390_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/413ecfdf-9198-4039-a77f-34a3ad6bd1ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/4b2eee3a-7b32-4756-96f9-ec86fecb9ebd_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/0755e8cb-d879-4ac0-9e87-ae0aee3aede3_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/8d8070a8-d31b-4d14-89c4-bd9add7f6c3e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 12/19 4K 12/20 13K 12/21 15K 01/23 22K 04/24 32K 03/25 39K', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 115, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cbb809c2-c6a3-474e-85e4-43507be38cad.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117131550, 'registration': 'BH19XWJ', 'account': 'WIL004', 'make': 'CITROEN', 'model': 'GRAND C4 SPACETOURER ESTATE (RC)', 'derivative': '1.2 PureTech 130 Flair 5dr', 'mileage': 44461, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-08-12', 'fuel': 'Petrol', 'motExpiry': '2026-08-11', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/f4eff252-fb17-4b3c-a49b-431948aaae35_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/f693600e-cd70-4b99-a583-152af9014350_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/cc966adf-816c-4cb4-a223-76af9f6756ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/fb5bb530-683d-4cba-adc5-f4bbc3788d24_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/79430369-61e5-46fc-b127-3f8342c7041c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/5fb27594-c4ef-43c7-9a19-83acc4a28e93_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/98eeb9ce-36b2-456f-9675-a75015b88390_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/413ecfdf-9198-4039-a77f-34a3ad6bd1ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/4b2eee3a-7b32-4756-96f9-ec86fecb9ebd_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/0755e8cb-d879-4ac0-9e87-ae0aee3aede3_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/8d8070a8-d31b-4d14-89c4-bd9add7f6c3e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 12/19 4K 12/20 13K 12/21 15K 01/23 22K 04/24 32K 03/25 39K', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 115, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cbb809c2-c6a3-474e-85e4-43507be38cad.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e16b1caf-3652-5871-a205-1b3f29f09607 with identifier: 117131550
2025-12-01 19:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e16b1caf-3652-5871-a205-1b3f29f09607 with scrape type 2
2025-12-01 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e16b1caf-3652-5871-a205-1b3f29f09607 with scrape type 2
2025-12-01 19:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e16b1caf-3652-5871-a205-1b3f29f09607, identifier: 117131550
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117123611, 'registration': 'WA66VEH', 'account': 'MER023', 'make': 'TOYOTA', 'model': 'RAV4 ESTATE', 'derivative': '2.5 VVT-i Hybrid Excel TSS 5dr CVT', 'mileage': 51049, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-09-02', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-09-27', 'doors': 5, 'engineSize': 2494, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WA66VEH/2025-11-12/image/ac6cd81d-5d2f-4688-879e-6ba8bab42e6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/6f50a6f9-75e5-4038-9b4d-f87c6220cd10_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/d2d9b5e3-d975-4498-9456-17b5eb68bcea_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/3db2d2a4-7f26-4188-8ace-99d4c4391b10_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/2370c42d-2583-4c08-9b29-d38da6aa6b37_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/52db6d09-e166-40f0-9823-22bad00d955c_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/3af56105-8e0a-4772-8ee8-d43cbfb9d903_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/abbf0ad8-0cdb-4c55-8c37-09a6c215e8a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/7d0a08b8-7e74-4c29-b60b-40de1b1be7dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/d973d60b-a982-4c38-bebe-507a2103e702_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/33900aa9-2b51-4638-930e-61dd9d76d285_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 09/25 50K', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/302718e4-8618-455b-be8c-7893a498c9fe.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117123611, 'registration': 'WA66VEH', 'account': 'MER023', 'make': 'TOYOTA', 'model': 'RAV4 ESTATE', 'derivative': '2.5 VVT-i Hybrid Excel TSS 5dr CVT', 'mileage': 51049, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-09-02', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-09-27', 'doors': 5, 'engineSize': 2494, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WA66VEH/2025-11-12/image/ac6cd81d-5d2f-4688-879e-6ba8bab42e6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/6f50a6f9-75e5-4038-9b4d-f87c6220cd10_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/d2d9b5e3-d975-4498-9456-17b5eb68bcea_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/3db2d2a4-7f26-4188-8ace-99d4c4391b10_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/2370c42d-2583-4c08-9b29-d38da6aa6b37_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/52db6d09-e166-40f0-9823-22bad00d955c_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/3af56105-8e0a-4772-8ee8-d43cbfb9d903_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/abbf0ad8-0cdb-4c55-8c37-09a6c215e8a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/7d0a08b8-7e74-4c29-b60b-40de1b1be7dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/d973d60b-a982-4c38-bebe-507a2103e702_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA66VEH/2025-11-12/image/33900aa9-2b51-4638-930e-61dd9d76d285_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 09/25 50K', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/302718e4-8618-455b-be8c-7893a498c9fe.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87f0d085-784f-5505-aee0-1b2eac3fd35c with identifier: 117123611
2025-12-01 19:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87f0d085-784f-5505-aee0-1b2eac3fd35c with scrape type 2
2025-12-01 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87f0d085-784f-5505-aee0-1b2eac3fd35c with scrape type 2
2025-12-01 19:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 87f0d085-784f-5505-aee0-1b2eac3fd35c, identifier: 117123611
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117243071, 'registration': 'PN19TFE', 'account': 'WIL004', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T 160 N-Connecta 5dr', 'mileage': 46730, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-06-28', 'fuel': 'Petrol', 'motExpiry': '2026-08-30', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PN19TFE/2025-11-19/image/ff6a533c-7a71-41fc-a82a-f02229dfaddf_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/e8775db4-a7c5-4e66-b9cb-7ea943022429_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/f0273086-c915-41cc-af57-e26f783878af_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/15202e68-a80b-4e6a-aa45-ae09e1a304ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/18f7690b-0781-475b-86c7-58076effbe93_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/d51971c3-8376-4813-9f0f-2782a1f4ee6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/be766b33-81f0-4df4-9188-ae11aac650fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/bd8568bc-35b1-4154-9820-da18eb307293_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/a34457d6-9af4-41e4-9726-0f756279b9e4_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 10/22 25K 08/23 30K 08/24 38K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/13710208-7bbc-4fca-8548-3fa49b124abd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117243071, 'registration': 'PN19TFE', 'account': 'WIL004', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T 160 N-Connecta 5dr', 'mileage': 46730, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-06-28', 'fuel': 'Petrol', 'motExpiry': '2026-08-30', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PN19TFE/2025-11-19/image/ff6a533c-7a71-41fc-a82a-f02229dfaddf_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/e8775db4-a7c5-4e66-b9cb-7ea943022429_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/f0273086-c915-41cc-af57-e26f783878af_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/15202e68-a80b-4e6a-aa45-ae09e1a304ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/18f7690b-0781-475b-86c7-58076effbe93_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/d51971c3-8376-4813-9f0f-2782a1f4ee6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/be766b33-81f0-4df4-9188-ae11aac650fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/bd8568bc-35b1-4154-9820-da18eb307293_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/a34457d6-9af4-41e4-9726-0f756279b9e4_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 10/22 25K 08/23 30K 08/24 38K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/13710208-7bbc-4fca-8548-3fa49b124abd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5 with identifier: 117243071
2025-12-01 19:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5 with scrape type 2
2025-12-01 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5 with scrape type 2
2025-12-01 19:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5, identifier: 117243071
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117175584, 'registration': 'YE20USZ', 'account': 'WIL004', 'make': 'FORD', 'model': 'FOCUS DIESEL ESTATE', 'derivative': '1.5 EcoBlue 120 Active X 5dr', 'mileage': 53373, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2020-06-17', 'fuel': 'Diesel', 'motExpiry': '2026-04-16', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YE20USZ/2025-11-18/image/ff6a0a32-e9c9-48f9-8710-82bda23066bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/9bf0b407-f58b-4abf-a04b-8a33e6ceb70f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/ff1700f9-12fb-42f6-aca3-54246badf853_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/3b4db2be-395b-4c00-aa88-7b5b16e8dc39_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/f946f23e-9f36-4724-9f67-cf4655ff471c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/21dbc6dd-427b-46c3-873a-d91784820ae6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/db73a3c7-ed7d-450f-b021-a27fe9c755b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/75be46ea-911b-421b-abf8-bcdd230148a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/6dbd76d3-010b-407e-b8fb-5af132f6661a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/2fc890e8-a8ea-4103-9ad3-5ec93b6d9f39_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 06/23 9K 07/24 29K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9276b3bc-ebf2-44a9-9fa5-1d7c85672c41.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117175584, 'registration': 'YE20USZ', 'account': 'WIL004', 'make': 'FORD', 'model': 'FOCUS DIESEL ESTATE', 'derivative': '1.5 EcoBlue 120 Active X 5dr', 'mileage': 53373, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2020-06-17', 'fuel': 'Diesel', 'motExpiry': '2026-04-16', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YE20USZ/2025-11-18/image/ff6a0a32-e9c9-48f9-8710-82bda23066bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/9bf0b407-f58b-4abf-a04b-8a33e6ceb70f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/ff1700f9-12fb-42f6-aca3-54246badf853_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/3b4db2be-395b-4c00-aa88-7b5b16e8dc39_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/f946f23e-9f36-4724-9f67-cf4655ff471c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/21dbc6dd-427b-46c3-873a-d91784820ae6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/db73a3c7-ed7d-450f-b021-a27fe9c755b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/75be46ea-911b-421b-abf8-bcdd230148a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/6dbd76d3-010b-407e-b8fb-5af132f6661a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/2fc890e8-a8ea-4103-9ad3-5ec93b6d9f39_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 06/23 9K 07/24 29K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9276b3bc-ebf2-44a9-9fa5-1d7c85672c41.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 910f4a33-d3b5-573d-a08f-06650114b76d with identifier: 117175584
2025-12-01 19:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 910f4a33-d3b5-573d-a08f-06650114b76d with scrape type 2
2025-12-01 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 910f4a33-d3b5-573d-a08f-06650114b76d with scrape type 2
2025-12-01 19:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 910f4a33-d3b5-573d-a08f-06650114b76d, identifier: 117175584
2025-12-01 19:00:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f240110>
2025-12-01 19:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89214aa6-43de-5869-9911-0711c93784fc/89214aa6-43de-5869-9911-0711c93784fc_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA19YRV%252F2025-12-01%252Fimage%252F4a1c666f-01a8-405c-9dc2-d49f862447aa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19YRV/2025-12-01/image/4a1c666f-01a8-405c-9dc2-d49f862447aa_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 89214aa6-43de-5869-9911-0711c93784fc
2025-12-01 19:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YR66YCG/2025-12-01/image/c7105256-bcd1-4d20-8846-5f0fe0d1d477_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117609015?view=catalogue)
2025-12-01 19:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DE17YWV/2025-12-01/image/cd7be7de-093c-4c2d-a0f6-104567d25a66_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117636439?view=catalogue)
2025-12-01 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 117550449
2025-12-01 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550449%27 HTTP/1.1" 200 None
2025-12-01 19:00:35 [astonbarclay.gb] INFO: Scrape type for 117550449: 0
2025-12-01 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 117549874
2025-12-01 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549874%27 HTTP/1.1" 200 None
2025-12-01 19:00:35 [astonbarclay.gb] INFO: Scrape type for 117549874: 0
2025-12-01 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 117549131
2025-12-01 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549131%27 HTTP/1.1" 200 None
2025-12-01 19:00:35 [astonbarclay.gb] INFO: Scrape type for 117549131: 1
2025-12-01 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDE17YWV%252F2025-12-01%252Fimage%252F3e549e1c-5ec9-4d0c-b2d1-329320697f86_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE17YWV/2025-12-01/image/3e549e1c-5ec9-4d0c-b2d1-329320697f86_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 590613a5-74b5-5f62-bf45-ebc1e4651545 with identifier: 117243027
2025-12-01 19:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-01 19:00:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=RED%2FBLACK HTTP/1.1" 200 None
2025-12-01 19:00:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-01 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-01 19:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 590613a5-74b5-5f62-bf45-ebc1e4651545 with identifier: 117243027
2025-12-01 19:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 590613a5-74b5-5f62-bf45-ebc1e4651545 with identifier: 117243027 to the API
2025-12-01 19:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27590613a5-74b5-5f62-bf45-ebc1e4651545%27 HTTP/1.1" 200 None
2025-12-01 19:00:35 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 590613a5-74b5-5f62-bf45-ebc1e4651545: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:00:34 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117243027?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '590613a5-74b5-5f62-bf45-ebc1e4651545',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'HS16KYR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117243027',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'RENAULT',
 'model': 'CAPTUR DIESEL HATCHBACK',
 'odometer': 61234,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-28',
 'seller_name': 'Wilsons',
 'title': 'RENAULT CAPTUR DIESEL HATCHBACK 1.5 dCi 90 Signature Nav 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.5 dCi 90 Signature Nav 5dr Auto',
 'vin': None,
 'year': 2016}
2025-12-01 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117243027%27 HTTP/1.1" 200 None
2025-12-01 19:00:35 [astonbarclay.gb] INFO: Saving data for 117243027: {'auction_closing_time': 1764755100.0, 'created_time': 1763492797.01041, 'last_price_update_time': 1764615635.738133}
2025-12-01 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117243027') HTTP/1.1" 204 0
2025-12-01 19:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 68718674-16a5-5d6f-aa5f-eef5f6f7ec21 with identifier: 117635994
2025-12-01 19:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-01 19:00:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=RED HTTP/1.1" 200 None
2025-12-01 19:00:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-01 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-01 19:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-01 19:00:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Electric HTTP/1.1" 200 None
2025-12-01 19:00:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-01 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-01 19:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 68718674-16a5-5d6f-aa5f-eef5f6f7ec21 with identifier: 117635994
2025-12-01 19:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'account lowratecarfinance ltd t/a somerset motor company', 'price_includes_vat': False, 'title': 'hyundai ioniq electric hatchback 100kw premium 38kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'ioniq electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 87845, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-02', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117635994', 'expiration_date': '2025-12-03t09:45:00z', 'location': 'aston barclay westbury', 'origin_country_code': 'gb', 'trim': '100kw premium 38kwh 5dr auto', 'license_plate': 'ck71ztu', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '68718674-16a5-5d6f-aa5f-eef5f6f7ec21', 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'hyundai ioniq electric hatchback', 'sanitized_make': 'hyundai', 'odometer_in_km': 141372} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-03t09:45:00z',
     'fuel_type': 'electric',
     'id': '68718674-16a5-5d6f-aa5f-eef5f6f7ec21',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ck71ztu',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117635994',
     'listing': 'auction',
     'location': 'aston barclay westbury',
     'make': 'hyundai',
     'make_model': 'hyundai ioniq electric hatchback',
     'model': 'ioniq electric hatchback',
     'odometer': 87845,
     'odometer_in_km': 141372,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-02',
     'sanitized_make': 'hyundai',
     'seller_name': 'account lowratecarfinance ltd t/a somerset motor '
                    'company',
     'title': 'hyundai ioniq electric hatchback 100kw premium 38kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '100kw premium 38kwh 5dr auto',
     'vin': None,
     'year': 2021}
2025-12-01 19:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 68718674-16a5-5d6f-aa5f-eef5f6f7ec21 spider: astonbarclay.gb
2025-12-01 19:00:36 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 68718674-16a5-5d6f-aa5f-eef5f6f7ec21 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'account lowratecarfinance ltd t/a somerset motor company', 'price_includes_vat': False, 'title': 'hyundai ioniq electric hatchback 100kw premium 38kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'ioniq electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 87845, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-02', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117635994', 'expiration_date': '2025-12-03t09:45:00z', 'location': 'aston barclay westbury', 'origin_country_code': 'gb', 'trim': '100kw premium 38kwh 5dr auto', 'license_plate': 'ck71ztu', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '68718674-16a5-5d6f-aa5f-eef5f6f7ec21', 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'hyundai ioniq electric hatchback', 'sanitized_make': 'hyundai', 'odometer_in_km': 141372} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-03t09:45:00z',
     'fuel_type': 'electric',
     'id': '68718674-16a5-5d6f-aa5f-eef5f6f7ec21',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ck71ztu',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117635994',
     'listing': 'auction',
     'location': 'aston barclay westbury',
     'make': 'hyundai',
     'make_model': 'hyundai ioniq electric hatchback',
     'model': 'ioniq electric hatchback',
     'odometer': 87845,
     'odometer_in_km': 141372,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-02',
     'sanitized_make': 'hyundai',
     'seller_name': 'account lowratecarfinance ltd t/a somerset motor '
                    'company',
     'title': 'hyundai ioniq electric hatchback 100kw premium 38kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '100kw premium 38kwh 5dr auto',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Electric',
 'id': '68718674-16a5-5d6f-aa5f-eef5f6f7ec21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'CK71ZTU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117635994',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'HYUNDAI',
 'model': 'IONIQ ELECTRIC HATCHBACK',
 'odometer': 87845,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-02',
 'seller_name': 'Account Lowratecarfinance Ltd t/a Somerset Motor Company',
 'title': 'HYUNDAI IONIQ ELECTRIC HATCHBACK 100kW Premium 38kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '100kW Premium 38kWh 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-01 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117635994%27 HTTP/1.1" 200 None
2025-12-01 19:00:36 [astonbarclay.gb] INFO: Saving data for 117635994: {'created_time': 1764615636.39271, 'last_price_update_time': 1764615636.392721, 'auction_closing_time': 1764755100.0}
2025-12-01 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117635994') HTTP/1.1" 204 0
2025-12-01 19:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e16b1caf-3652-5871-a205-1b3f29f09607 with identifier: 117131550
2025-12-01 19:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-01 19:00:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLACK HTTP/1.1" 200 None
2025-12-01 19:00:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-01 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-01 19:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e16b1caf-3652-5871-a205-1b3f29f09607 with identifier: 117131550
2025-12-01 19:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e16b1caf-3652-5871-a205-1b3f29f09607 with identifier: 117131550 to the API
2025-12-01 19:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27e16b1caf-3652-5871-a205-1b3f29f09607%27 HTTP/1.1" 200 None
2025-12-01 19:00:36 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id e16b1caf-3652-5871-a205-1b3f29f09607: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:00:35 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117131550?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'e16b1caf-3652-5871-a205-1b3f29f09607',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BH19XWJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117131550',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'CITROEN',
 'model': 'GRAND C4 SPACETOURER ESTATE (RC)',
 'odometer': 44461,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-12',
 'seller_name': 'Wilsons',
 'title': 'CITROEN GRAND C4 SPACETOURER ESTATE (RC) 1.2 PureTech 130 Flair 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 130 Flair 5dr',
 'vin': None,
 'year': 2019}
2025-12-01 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117131550%27 HTTP/1.1" 200 None
2025-12-01 19:00:36 [astonbarclay.gb] INFO: Saving data for 117131550: {'auction_closing_time': 1764755100.0, 'created_time': 1763060638.767022, 'last_price_update_time': 1764615636.816703}
2025-12-01 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117131550') HTTP/1.1" 204 0
2025-12-01 19:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 87f0d085-784f-5505-aee0-1b2eac3fd35c with identifier: 117123611
2025-12-01 19:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-01 19:00:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol%2FElectric+Hybrid HTTP/1.1" 200 None
2025-12-01 19:00:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-01 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-01 19:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 87f0d085-784f-5505-aee0-1b2eac3fd35c with identifier: 117123611
2025-12-01 19:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 87f0d085-784f-5505-aee0-1b2eac3fd35c with identifier: 117123611 to the API
2025-12-01 19:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117123611?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '87f0d085-784f-5505-aee0-1b2eac3fd35c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WA66VEH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117123611',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'TOYOTA',
 'model': 'RAV4 ESTATE',
 'odometer': 51049,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-02',
 'seller_name': 'Mercedes-Benz South West',
 'title': 'TOYOTA RAV4 ESTATE 2.5 VVT-i Hybrid Excel TSS 5dr CVT',
 'transmission': 'automatic',
 'trim': '2.5 VVT-i Hybrid Excel TSS 5dr CVT',
 'vin': None,
 'year': 2016}
2025-12-01 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117123611%27 HTTP/1.1" 200 None
2025-12-01 19:00:37 [astonbarclay.gb] INFO: Saving data for 117123611: {'auction_closing_time': 1764755100.0, 'created_time': 1762974234.097236, 'last_price_update_time': 1764615637.328563}
2025-12-01 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117123611') HTTP/1.1" 204 0
2025-12-01 19:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5 with identifier: 117243071
2025-12-01 19:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5 with identifier: 117243071
2025-12-01 19:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5 with identifier: 117243071 to the API
2025-12-01 19:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5%27 HTTP/1.1" 200 None
2025-12-01 19:00:37 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:00:36 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117243071?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PN19TFE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117243071',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 46730,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-28',
 'seller_name': 'Wilsons',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T 160 N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T 160 N-Connecta 5dr',
 'vin': None,
 'year': 2019}
2025-12-01 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117243071%27 HTTP/1.1" 200 None
2025-12-01 19:00:37 [astonbarclay.gb] INFO: Saving data for 117243071: {'auction_closing_time': 1764755100.0, 'created_time': 1763492786.433532, 'last_price_update_time': 1764615637.644725}
2025-12-01 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117243071') HTTP/1.1" 204 0
2025-12-01 19:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 910f4a33-d3b5-573d-a08f-06650114b76d with identifier: 117175584
2025-12-01 19:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 910f4a33-d3b5-573d-a08f-06650114b76d with identifier: 117175584
2025-12-01 19:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 910f4a33-d3b5-573d-a08f-06650114b76d with identifier: 117175584 to the API
2025-12-01 19:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27910f4a33-d3b5-573d-a08f-06650114b76d%27 HTTP/1.1" 200 None
2025-12-01 19:00:37 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 910f4a33-d3b5-573d-a08f-06650114b76d: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:00:36 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117175584?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '910f4a33-d3b5-573d-a08f-06650114b76d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YE20USZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117175584',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'FORD',
 'model': 'FOCUS DIESEL ESTATE',
 'odometer': 53373,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-17',
 'seller_name': 'Wilsons',
 'title': 'FORD FOCUS DIESEL ESTATE 1.5 EcoBlue 120 Active X 5dr',
 'transmission': 'manual',
 'trim': '1.5 EcoBlue 120 Active X 5dr',
 'vin': None,
 'year': 2020}
2025-12-01 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117175584%27 HTTP/1.1" 200 None
2025-12-01 19:00:37 [astonbarclay.gb] INFO: Saving data for 117175584: {'auction_closing_time': 1764755100.0, 'created_time': 1763146933.810574, 'last_price_update_time': 1764615637.935492}
2025-12-01 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117175584') HTTP/1.1" 204 0
2025-12-01 19:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA19YRV/2025-12-01/image/6bbaf1fb-75ea-4a14-b4ed-06bf0498a82f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117621114?view=catalogue)
2025-12-01 19:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WL19RLV/2025-12-01/image/ca6a3055-4e9c-42b6-93e6-7a8bb1e6056e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117632563?view=catalogue)
2025-12-01 19:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DE17YWV/2025-12-01/image/43ceb04c-2be2-45c9-bdd8-7e129924f0b1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117636439?view=catalogue)
2025-12-01 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 116674717
2025-12-01 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116674717%27 HTTP/1.1" 200 None
2025-12-01 19:00:37 [astonbarclay.gb] INFO: Scrape type for 116674717: 0
2025-12-01 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117607169
2025-12-01 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117607169%27 HTTP/1.1" 200 None
2025-12-01 19:00:37 [astonbarclay.gb] INFO: Scrape type for 117607169: 0
2025-12-01 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117548257
2025-12-01 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117548257%27 HTTP/1.1" 200 None
2025-12-01 19:00:38 [astonbarclay.gb] INFO: Scrape type for 117548257: 0
2025-12-01 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 117415236
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117415236%27 HTTP/1.1" 200 None
2025-12-01 19:00:38 [astonbarclay.gb] INFO: Scrape type for 117415236: 0
2025-12-01 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 117514825
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117514825%27 HTTP/1.1" 200 None
2025-12-01 19:00:38 [astonbarclay.gb] INFO: Scrape type for 117514825: 0
2025-12-01 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 117514797
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117514797%27 HTTP/1.1" 200 None
2025-12-01 19:00:38 [astonbarclay.gb] INFO: Scrape type for 117514797: 0
2025-12-01 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 117609313
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117609313%27 HTTP/1.1" 200 None
2025-12-01 19:00:38 [astonbarclay.gb] INFO: Scrape type for 117609313: 0
2025-12-01 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 117541699
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117541699%27 HTTP/1.1" 200 None
2025-12-01 19:00:38 [astonbarclay.gb] INFO: Scrape type for 117541699: 0
2025-12-01 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 117537448
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117537448%27 HTTP/1.1" 200 None
2025-12-01 19:00:38 [astonbarclay.gb] INFO: Scrape type for 117537448: 0
2025-12-01 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 117002721
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117002721%27 HTTP/1.1" 200 None
2025-12-01 19:00:38 [astonbarclay.gb] INFO: Scrape type for 117002721: 1
2025-12-01 19:00:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e9a8110>
2025-12-01 19:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89214aa6-43de-5869-9911-0711c93784fc/89214aa6-43de-5869-9911-0711c93784fc_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA19YRV%252F2025-12-01%252Fimage%252F37233342-b6c1-4aae-9ee9-2ffe6be1a099_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19YRV/2025-12-01/image/37233342-b6c1-4aae-9ee9-2ffe6be1a099_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 89214aa6-43de-5869-9911-0711c93784fc
2025-12-01 19:00:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e998c90>
2025-12-01 19:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_806e8254-da45-58a2-9827-dc16cca75b5c/806e8254-da45-58a2-9827-dc16cca75b5c_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYR66YCG%252F2025-12-01%252Fimage%252Fc5931db0-1018-4af3-830a-5cb191d14c39_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR66YCG/2025-12-01/image/c5931db0-1018-4af3-830a-5cb191d14c39_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 806e8254-da45-58a2-9827-dc16cca75b5c
2025-12-01 19:00:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e9a6090>
2025-12-01 19:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89214aa6-43de-5869-9911-0711c93784fc/89214aa6-43de-5869-9911-0711c93784fc_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA19YRV%252F2025-12-01%252Fimage%252Fc4ec43eb-d5cb-456b-aee2-a3ffe38f099f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19YRV/2025-12-01/image/c4ec43eb-d5cb-456b-aee2-a3ffe38f099f_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 89214aa6-43de-5869-9911-0711c93784fc
2025-12-01 19:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YR66YCG/2025-12-01/image/63f13649-bbea-4df9-bd58-9089925d3ae6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117609015?view=catalogue)
2025-12-01 19:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YR66YCG/2025-12-01/image/1416b83a-0a0d-4e37-b01d-8a7e38bc0040_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117609015?view=catalogue)
2025-12-01 19:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DE17YWV/2025-12-01/image/f1b9b5b3-b66a-409c-8624-6d465ff90acf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117636439?view=catalogue)
2025-12-01 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 117501383
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117501383%27 HTTP/1.1" 200 None
2025-12-01 19:00:38 [astonbarclay.gb] INFO: Scrape type for 117501383: 0
2025-12-01 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 117481203
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117481203%27 HTTP/1.1" 200 None
2025-12-01 19:00:38 [astonbarclay.gb] INFO: Scrape type for 117481203: 0
2025-12-01 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 117611334
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117611334%27 HTTP/1.1" 200 None
2025-12-01 19:00:38 [astonbarclay.gb] INFO: Scrape type for 117611334: 0
2025-12-01 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 117207172
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117207172%27 HTTP/1.1" 200 None
2025-12-01 19:00:38 [astonbarclay.gb] INFO: Scrape type for 117207172: 2
2025-12-01 19:00:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f2f7c50>
2025-12-01 19:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_806e8254-da45-58a2-9827-dc16cca75b5c/806e8254-da45-58a2-9827-dc16cca75b5c_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYR66YCG%252F2025-12-01%252Fimage%252Fc7105256-bcd1-4d20-8846-5f0fe0d1d477_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR66YCG/2025-12-01/image/c7105256-bcd1-4d20-8846-5f0fe0d1d477_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 806e8254-da45-58a2-9827-dc16cca75b5c
2025-12-01 19:00:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f2f6f50>
2025-12-01 19:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fc61c1e-27fc-5109-8c11-3436b81e5022/6fc61c1e-27fc-5109-8c11-3436b81e5022_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDE17YWV%252F2025-12-01%252Fimage%252Fcd7be7de-093c-4c2d-a0f6-104567d25a66_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE17YWV/2025-12-01/image/cd7be7de-093c-4c2d-a0f6-104567d25a66_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6fc61c1e-27fc-5109-8c11-3436b81e5022
2025-12-01 19:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117579570?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117596913?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117495142?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f716110>
2025-12-01 19:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89214aa6-43de-5869-9911-0711c93784fc/89214aa6-43de-5869-9911-0711c93784fc_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA19YRV%252F2025-12-01%252Fimage%252F6bbaf1fb-75ea-4a14-b4ed-06bf0498a82f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19YRV/2025-12-01/image/6bbaf1fb-75ea-4a14-b4ed-06bf0498a82f_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 89214aa6-43de-5869-9911-0711c93784fc
2025-12-01 19:00:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f715b90>
2025-12-01 19:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315a462f-b1fb-5767-99b3-d3e45f95653b/315a462f-b1fb-5767-99b3-d3e45f95653b_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWL19RLV%252F2025-12-01%252Fimage%252Fca6a3055-4e9c-42b6-93e6-7a8bb1e6056e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WL19RLV/2025-12-01/image/ca6a3055-4e9c-42b6-93e6-7a8bb1e6056e_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 315a462f-b1fb-5767-99b3-d3e45f95653b
2025-12-01 19:00:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f215f10>
2025-12-01 19:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fc61c1e-27fc-5109-8c11-3436b81e5022/6fc61c1e-27fc-5109-8c11-3436b81e5022_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDE17YWV%252F2025-12-01%252Fimage%252F43ceb04c-2be2-45c9-bdd8-7e129924f0b1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE17YWV/2025-12-01/image/43ceb04c-2be2-45c9-bdd8-7e129924f0b1_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6fc61c1e-27fc-5109-8c11-3436b81e5022
2025-12-01 19:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YR66YCG/2025-12-01/image/0c12bf38-d294-4916-af8c-afb2632f1339_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117609015?view=catalogue)
2025-12-01 19:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DE17YWV/2025-12-01/image/3e549e1c-5ec9-4d0c-b2d1-329320697f86_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117636439?view=catalogue)
2025-12-01 19:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DE17YWV/2025-12-01/image/67195d9c-b82b-45ce-b970-38ec4af90eae_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117636439?view=catalogue)
2025-12-01 19:00:40 [astonbarclay.gb] INFO: Found listing with ID: 117483520
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117483520%27 HTTP/1.1" 200 None
2025-12-01 19:00:40 [astonbarclay.gb] INFO: Scrape type for 117483520: 0
2025-12-01 19:00:40 [astonbarclay.gb] INFO: Found listing with ID: 117612919
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117612919%27 HTTP/1.1" 200 None
2025-12-01 19:00:40 [astonbarclay.gb] INFO: Scrape type for 117612919: 0
2025-12-01 19:00:40 [astonbarclay.gb] INFO: Found listing with ID: 117612955
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117612955%27 HTTP/1.1" 200 None
2025-12-01 19:00:40 [astonbarclay.gb] INFO: Scrape type for 117612955: 0
2025-12-01 19:00:40 [astonbarclay.gb] INFO: Found listing with ID: 117480843
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117480843%27 HTTP/1.1" 200 None
2025-12-01 19:00:40 [astonbarclay.gb] INFO: Scrape type for 117480843: 0
2025-12-01 19:00:40 [astonbarclay.gb] INFO: Found listing with ID: 117207188
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117207188%27 HTTP/1.1" 200 None
2025-12-01 19:00:40 [astonbarclay.gb] INFO: Scrape type for 117207188: 2
2025-12-01 19:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117024415?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117583759?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117576078?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f2d4890>
2025-12-01 19:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_806e8254-da45-58a2-9827-dc16cca75b5c/806e8254-da45-58a2-9827-dc16cca75b5c_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYR66YCG%252F2025-12-01%252Fimage%252F63f13649-bbea-4df9-bd58-9089925d3ae6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR66YCG/2025-12-01/image/63f13649-bbea-4df9-bd58-9089925d3ae6_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 806e8254-da45-58a2-9827-dc16cca75b5c
2025-12-01 19:00:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f221690>
2025-12-01 19:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_806e8254-da45-58a2-9827-dc16cca75b5c/806e8254-da45-58a2-9827-dc16cca75b5c_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYR66YCG%252F2025-12-01%252Fimage%252F1416b83a-0a0d-4e37-b01d-8a7e38bc0040_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR66YCG/2025-12-01/image/1416b83a-0a0d-4e37-b01d-8a7e38bc0040_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 806e8254-da45-58a2-9827-dc16cca75b5c
2025-12-01 19:00:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e83e4d0>
2025-12-01 19:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fc61c1e-27fc-5109-8c11-3436b81e5022/6fc61c1e-27fc-5109-8c11-3436b81e5022_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDE17YWV%252F2025-12-01%252Fimage%252Ff1b9b5b3-b66a-409c-8624-6d465ff90acf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE17YWV/2025-12-01/image/f1b9b5b3-b66a-409c-8624-6d465ff90acf_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6fc61c1e-27fc-5109-8c11-3436b81e5022
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117548417
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117548417%27 HTTP/1.1" 200 None
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117548417: 1
2025-12-01 19:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA19YRV/2025-12-01/image/a8860e8a-3fb3-4c6e-93b3-dabae7aef4b9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117621114?view=catalogue)
2025-12-01 19:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DE17YWV/2025-12-01/image/ceac24e4-53c0-48f2-be99-91fb0dc82a3b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117636439?view=catalogue)
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117579570, 'registration': 'GX17XEK', 'account': 'SMR001', 'make': 'TOYOTA', 'model': 'PROACE VERSO DIESEL ESTATE', 'derivative': '2.0D 180 Family Compact 5dr Auto', 'mileage': 295495, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-03-09', 'fuel': 'Diesel', 'motExpiry': '2026-09-15', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'Ex-Private Hire', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117579570, 'registration': 'GX17XEK', 'account': 'SMR001', 'make': 'TOYOTA', 'model': 'PROACE VERSO DIESEL ESTATE', 'derivative': '2.0D 180 Family Compact 5dr Auto', 'mileage': 295495, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-03-09', 'fuel': 'Diesel', 'motExpiry': '2026-09-15', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'Ex-Private Hire', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c008faa-c552-5f38-9785-deb0e5cd530c with identifier: 117579570
2025-12-01 19:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c008faa-c552-5f38-9785-deb0e5cd530c with scrape type 1
2025-12-01 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 9c008faa-c552-5f38-9785-deb0e5cd530c
2025-12-01 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 9c008faa-c552-5f38-9785-deb0e5cd530c
2025-12-01 19:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9c008faa-c552-5f38-9785-deb0e5cd530c, identifier: 117579570
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117596913, 'registration': 'ET17TNV', 'account': 'SMC010', 'make': 'FORD', 'model': 'S-MAX DIESEL ESTATE', 'derivative': '2.0 TDCi 150 Titanium 5dr', 'mileage': 79405, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-06-30', 'fuel': 'Diesel', 'motExpiry': '2026-07-08', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/ET17TNV/2025-12-01/image/c2749c85-11d6-4b3d-9254-e58ccdbd81e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET17TNV/2025-12-01/image/e658696e-fe29-4266-9d14-4fafc4234d58_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET17TNV/2025-12-01/image/a23519b1-141a-489d-8ae3-066427c44f25_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET17TNV/2025-12-01/image/5f65e192-02f6-46c1-86c7-b818124a8eca_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET17TNV/2025-12-01/image/9af11aa6-f189-488f-8341-502ca7506746_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET17TNV/2025-12-01/image/cdd6f396-36f2-47d7-875a-59e91c12d5ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET17TNV/2025-12-01/image/008c7464-e0c0-4f44-9054-7f8ee27989ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET17TNV/2025-12-01/image/8b12ae8d-d896-478d-aed8-d1600b6e77f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET17TNV/2025-12-01/image/3049ae76-41a8-4209-834d-73f2b0dba9cc_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/18 12K - 12/18 19K - 10/19 32K - 07/20 37K - 06/21 24K -', 'remarks': 'VOSA STATES, 53K, 60K, 69K, 76K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'SMC Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e34bcd33-f4a0-4f51-b4bf-be012d2522b0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117596913, 'registration': 'ET17TNV', 'account': 'SMC010', 'make': 'FORD', 'model': 'S-MAX DIESEL ESTATE', 'derivative': '2.0 TDCi 150 Titanium 5dr', 'mileage': 79405, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-06-30', 'fuel': 'Diesel', 'motExpiry': '2026-07-08', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/ET17TNV/2025-12-01/image/c2749c85-11d6-4b3d-9254-e58ccdbd81e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET17TNV/2025-12-01/image/e658696e-fe29-4266-9d14-4fafc4234d58_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET17TNV/2025-12-01/image/a23519b1-141a-489d-8ae3-066427c44f25_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET17TNV/2025-12-01/image/5f65e192-02f6-46c1-86c7-b818124a8eca_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET17TNV/2025-12-01/image/9af11aa6-f189-488f-8341-502ca7506746_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET17TNV/2025-12-01/image/cdd6f396-36f2-47d7-875a-59e91c12d5ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET17TNV/2025-12-01/image/008c7464-e0c0-4f44-9054-7f8ee27989ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET17TNV/2025-12-01/image/8b12ae8d-d896-478d-aed8-d1600b6e77f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET17TNV/2025-12-01/image/3049ae76-41a8-4209-834d-73f2b0dba9cc_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/18 12K - 12/18 19K - 10/19 32K - 07/20 37K - 06/21 24K -', 'remarks': 'VOSA STATES, 53K, 60K, 69K, 76K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'SMC Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e34bcd33-f4a0-4f51-b4bf-be012d2522b0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7553a85-b1d7-5800-8c41-acd80624ea68 with identifier: 117596913
2025-12-01 19:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7553a85-b1d7-5800-8c41-acd80624ea68 with scrape type 1
2025-12-01 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item c7553a85-b1d7-5800-8c41-acd80624ea68
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FET17TNV%252F2025-12-01%252Fimage%252Fc2749c85-11d6-4b3d-9254-e58ccdbd81e3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET17TNV/2025-12-01/image/c2749c85-11d6-4b3d-9254-e58ccdbd81e3_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117495142, 'registration': 'GC65DZW', 'account': 'MOD010', 'make': 'VOLKSWAGEN', 'model': 'POLO HATCHBACK', 'derivative': '1.2 TSI SE 5dr', 'mileage': 85302, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-02-09', 'fuel': 'Petrol', 'motExpiry': '2026-01-24', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GC65DZW/2025-11-26/image/2ad9e4a6-212a-4eb3-b8dd-1f3826fa4ac4_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC65DZW/2025-11-26/image/0aec4fc0-ccfe-45e3-8be1-16be96c04689_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC65DZW/2025-11-26/image/a07d8dde-542c-4e65-a443-d6de9c812000_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC65DZW/2025-11-26/image/ec6e9e30-66ba-4173-a850-9625294d9298_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC65DZW/2025-11-26/image/a128af62-2e45-4fa6-8bf7-680f3eda5aa4_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC65DZW/2025-11-26/image/7d8543f3-be50-4ffd-865d-e8a9f8cb2578_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC65DZW/2025-11-26/image/37d9c286-8ba9-40f0-88a3-efe5214b23c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC65DZW/2025-11-26/image/747a7451-dce7-4096-adb0-d6ee56a3f03d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC65DZW/2025-11-26/image/56c53d51-1db8-49f3-8d86-3c2f63d13992_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/17-10K 05/18-21K 03/19-29K 01/20-42K 03/21-48K 03/22-60K 04/23-69K 10/24-80K 07/25-84K', 'remarks': 'VOSA STATES 61K 69K 80K 82K', 'virtual': False, 'seller': 'Autolend', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '5', 'v5': True, 'v5details': 'Here', 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e0ab76c5-44fc-4436-be50-4f00253e5980.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117495142, 'registration': 'GC65DZW', 'account': 'MOD010', 'make': 'VOLKSWAGEN', 'model': 'POLO HATCHBACK', 'derivative': '1.2 TSI SE 5dr', 'mileage': 85302, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-02-09', 'fuel': 'Petrol', 'motExpiry': '2026-01-24', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GC65DZW/2025-11-26/image/2ad9e4a6-212a-4eb3-b8dd-1f3826fa4ac4_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC65DZW/2025-11-26/image/0aec4fc0-ccfe-45e3-8be1-16be96c04689_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC65DZW/2025-11-26/image/a07d8dde-542c-4e65-a443-d6de9c812000_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC65DZW/2025-11-26/image/ec6e9e30-66ba-4173-a850-9625294d9298_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC65DZW/2025-11-26/image/a128af62-2e45-4fa6-8bf7-680f3eda5aa4_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC65DZW/2025-11-26/image/7d8543f3-be50-4ffd-865d-e8a9f8cb2578_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC65DZW/2025-11-26/image/37d9c286-8ba9-40f0-88a3-efe5214b23c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC65DZW/2025-11-26/image/747a7451-dce7-4096-adb0-d6ee56a3f03d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GC65DZW/2025-11-26/image/56c53d51-1db8-49f3-8d86-3c2f63d13992_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/17-10K 05/18-21K 03/19-29K 01/20-42K 03/21-48K 03/22-60K 04/23-69K 10/24-80K 07/25-84K', 'remarks': 'VOSA STATES 61K 69K 80K 82K', 'virtual': False, 'seller': 'Autolend', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '5', 'v5': True, 'v5details': 'Here', 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e0ab76c5-44fc-4436-be50-4f00253e5980.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a41a9bad-985b-5457-94ae-8b214ecf4c78 with identifier: 117495142
2025-12-01 19:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a41a9bad-985b-5457-94ae-8b214ecf4c78 with scrape type 1
2025-12-01 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item a41a9bad-985b-5457-94ae-8b214ecf4c78
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGC65DZW%252F2025-11-26%252Fimage%252F2ad9e4a6-212a-4eb3-b8dd-1f3826fa4ac4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GC65DZW/2025-11-26/image/2ad9e4a6-212a-4eb3-b8dd-1f3826fa4ac4_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117546439
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117546439%27 HTTP/1.1" 200 None
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117546439: 0
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117507636
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507636%27 HTTP/1.1" 200 None
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117507636: 0
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117613527
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117613527%27 HTTP/1.1" 200 None
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117613527: 0
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117045093
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117045093%27 HTTP/1.1" 200 None
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117045093: 0
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 116937928
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116937928%27 HTTP/1.1" 200 None
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Scrape type for 116937928: 0
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117614495
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117614495%27 HTTP/1.1" 200 None
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117614495: 0
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117245171
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117245171%27 HTTP/1.1" 200 None
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117245171: 0
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117615130
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615130%27 HTTP/1.1" 200 None
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117615130: 0
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117615414
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615414%27 HTTP/1.1" 200 None
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117615414: 0
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117615572
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615572%27 HTTP/1.1" 200 None
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117615572: 0
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 116377459
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116377459%27 HTTP/1.1" 200 None
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Scrape type for 116377459: 0
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117615483
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615483%27 HTTP/1.1" 200 None
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117615483: 0
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117566737
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117566737%27 HTTP/1.1" 200 None
2025-12-01 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117566737: 1
2025-12-01 19:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9c008faa-c552-5f38-9785-deb0e5cd530c with identifier: 117579570
2025-12-01 19:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9c008faa-c552-5f38-9785-deb0e5cd530c with identifier: 117579570
2025-12-01 19:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'auction plus', 'price_includes_vat': False, 'title': 'toyota proace verso diesel estate 2.0d 180 family compact 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'toyota', 'model': 'proace verso diesel estate', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 295495, 'odometer_reading_unit': 'mi', 'registration_date': '2017-03-09', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117579570', 'expiration_date': '2025-12-03t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '2.0d 180 family compact 5dr auto', 'license_plate': 'gx17xek', 'year': 2017, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 151, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '9c008faa-c552-5f38-9785-deb0e5cd530c', 'current_year_diff': 8, 'age_in_months': 104, 'make_model': 'toyota proace verso diesel estate', 'sanitized_make': 'toyota', 'odometer_in_km': 475551}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 104,
     'auction_title': '',
     'c_o_2_emission_value': 151,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '2.0l',
     'expiration_date': '2025-12-03t10:00:00z',
     'fuel_type': 'diesel',
     'id': '9c008faa-c552-5f38-9785-deb0e5cd530c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'gx17xek',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117579570',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'toyota',
     'make_model': 'toyota proace verso diesel estate',
     'model': 'proace verso diesel estate',
     'odometer': 295495,
     'odometer_in_km': 475551,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2017-03-09',
     'sanitized_make': 'toyota',
     'seller_name': 'auction plus',
     'title': 'toyota proace verso diesel estate 2.0d 180 family compact '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '2.0d 180 family compact 5dr auto',
     'vin': None,
     'year': 2017}
2025-12-01 19:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 9c008faa-c552-5f38-9785-deb0e5cd530c spider: astonbarclay.gb
2025-12-01 19:00:42 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 9c008faa-c552-5f38-9785-deb0e5cd530c due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'auction plus', 'price_includes_vat': False, 'title': 'toyota proace verso diesel estate 2.0d 180 family compact 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'toyota', 'model': 'proace verso diesel estate', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 295495, 'odometer_reading_unit': 'mi', 'registration_date': '2017-03-09', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117579570', 'expiration_date': '2025-12-03t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '2.0d 180 family compact 5dr auto', 'license_plate': 'gx17xek', 'year': 2017, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 151, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '9c008faa-c552-5f38-9785-deb0e5cd530c', 'current_year_diff': 8, 'age_in_months': 104, 'make_model': 'toyota proace verso diesel estate', 'sanitized_make': 'toyota', 'odometer_in_km': 475551}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 104,
     'auction_title': '',
     'c_o_2_emission_value': 151,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '2.0l',
     'expiration_date': '2025-12-03t10:00:00z',
     'fuel_type': 'diesel',
     'id': '9c008faa-c552-5f38-9785-deb0e5cd530c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'gx17xek',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117579570',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'toyota',
     'make_model': 'toyota proace verso diesel estate',
     'model': 'proace verso diesel estate',
     'odometer': 295495,
     'odometer_in_km': 475551,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2017-03-09',
     'sanitized_make': 'toyota',
     'seller_name': 'auction plus',
     'title': 'toyota proace verso diesel estate 2.0d 180 family compact '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '2.0d 180 family compact 5dr auto',
     'vin': None,
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '9c008faa-c552-5f38-9785-deb0e5cd530c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GX17XEK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117579570',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'TOYOTA',
 'model': 'PROACE VERSO DIESEL ESTATE',
 'odometer': 295495,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-09',
 'seller_name': 'Auction Plus',
 'title': 'TOYOTA PROACE VERSO DIESEL ESTATE 2.0D 180 Family Compact 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0D 180 Family Compact 5dr Auto',
 'vin': None,
 'year': 2017}
2025-12-01 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117579570%27 HTTP/1.1" 200 None
2025-12-01 19:00:42 [astonbarclay.gb] INFO: Saving data for 117579570: {'created_time': 1764615642.22077, 'last_price_update_time': 1764615642.220783, 'auction_closing_time': 1764756000.0}
2025-12-01 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117579570') HTTP/1.1" 204 0
2025-12-01 19:00:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e7117d0>
2025-12-01 19:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_806e8254-da45-58a2-9827-dc16cca75b5c/806e8254-da45-58a2-9827-dc16cca75b5c_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYR66YCG%252F2025-12-01%252Fimage%252F0c12bf38-d294-4916-af8c-afb2632f1339_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR66YCG/2025-12-01/image/0c12bf38-d294-4916-af8c-afb2632f1339_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 806e8254-da45-58a2-9827-dc16cca75b5c
2025-12-01 19:00:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f2ea490>
2025-12-01 19:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fc61c1e-27fc-5109-8c11-3436b81e5022/6fc61c1e-27fc-5109-8c11-3436b81e5022_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDE17YWV%252F2025-12-01%252Fimage%252F3e549e1c-5ec9-4d0c-b2d1-329320697f86_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE17YWV/2025-12-01/image/3e549e1c-5ec9-4d0c-b2d1-329320697f86_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6fc61c1e-27fc-5109-8c11-3436b81e5022
2025-12-01 19:00:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e8fb390>
2025-12-01 19:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fc61c1e-27fc-5109-8c11-3436b81e5022/6fc61c1e-27fc-5109-8c11-3436b81e5022_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDE17YWV%252F2025-12-01%252Fimage%252F67195d9c-b82b-45ce-b970-38ec4af90eae_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE17YWV/2025-12-01/image/67195d9c-b82b-45ce-b970-38ec4af90eae_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6fc61c1e-27fc-5109-8c11-3436b81e5022
2025-12-01 19:00:43 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117024415, 'registration': 'WD67EHW', 'account': 'KCS002', 'make': 'FORD', 'model': 'ECOSPORT HATCHBACK', 'derivative': '1.0 EcoBoost 125 Zetec 5dr', 'mileage': 57860, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-01-31', 'fuel': 'Petrol', 'motExpiry': '2026-10-30', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WD67EHW/2025-11-07/image/4e6c47c1-3f2f-4488-afa1-fc8e12b014af_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/8136f56e-5784-460b-9336-a77ecefc8a8d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/3531f1d9-e65a-44ad-b833-0651b70f95c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/c803b8ca-86c6-4222-8785-1e0e90067805_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/c7ab2881-af9a-4a6a-ab74-0efaaf1ed393_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/07793055-c8de-4b5a-8568-5adc4491e6d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/db07c549-b6c9-460b-acab-7a74c34b2df5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/5a6fc851-6c3a-487b-9a87-b99f3c6474ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/da9892df-7993-4621-886d-ebd0e08c1eaa_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 01/19 10K 01/20 17K 01/22 41K 10/22 43K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2b8e862c-7c0c-4c96-aafc-ffba019b743b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:43 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117024415, 'registration': 'WD67EHW', 'account': 'KCS002', 'make': 'FORD', 'model': 'ECOSPORT HATCHBACK', 'derivative': '1.0 EcoBoost 125 Zetec 5dr', 'mileage': 57860, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-01-31', 'fuel': 'Petrol', 'motExpiry': '2026-10-30', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WD67EHW/2025-11-07/image/4e6c47c1-3f2f-4488-afa1-fc8e12b014af_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/8136f56e-5784-460b-9336-a77ecefc8a8d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/3531f1d9-e65a-44ad-b833-0651b70f95c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/c803b8ca-86c6-4222-8785-1e0e90067805_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/c7ab2881-af9a-4a6a-ab74-0efaaf1ed393_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/07793055-c8de-4b5a-8568-5adc4491e6d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/db07c549-b6c9-460b-acab-7a74c34b2df5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/5a6fc851-6c3a-487b-9a87-b99f3c6474ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD67EHW/2025-11-07/image/da9892df-7993-4621-886d-ebd0e08c1eaa_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 01/19 10K 01/20 17K 01/22 41K 10/22 43K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2b8e862c-7c0c-4c96-aafc-ffba019b743b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 547d852c-3964-53d0-a29b-7e0b93ff6074 with identifier: 117024415
2025-12-01 19:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 547d852c-3964-53d0-a29b-7e0b93ff6074 with scrape type 2
2025-12-01 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 547d852c-3964-53d0-a29b-7e0b93ff6074 with scrape type 2
2025-12-01 19:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 547d852c-3964-53d0-a29b-7e0b93ff6074, identifier: 117024415
2025-12-01 19:00:43 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117583759, 'registration': 'LB66AVM', 'account': 'STE093', 'make': 'BMW', 'model': '3 SERIES GRAN TURISMO DIESEL HATCHBACK', 'derivative': '335d xDrive M Sport 5dr Step Auto [Business Media]', 'mileage': 48944, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-11-30', 'fuel': 'Diesel', 'motExpiry': '2026-01-26', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LB66AVM/2025-12-01/image/b387e301-c92b-44ff-b393-3ede44830b6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/1ee2b024-5002-4147-a8a5-1a6d9addde23_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/059e3e4d-3359-4fb7-97b2-ec35a2823d89_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/ca952cdc-1ef5-4030-b8ee-8ad926443e33_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/c233feda-fb26-4c8f-9198-1b3402a634ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/1edf8ba4-345d-4c2c-a13c-c588b2af83ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/f917434e-1f34-4d80-9d4e-dc94bd53757e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/09dd2531-a177-4090-b146-39b989553254_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/3bad41e8-555c-4d01-9e08-c58d2065170f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/eb36ef3d-ad39-4952-9e2f-d2cd6c843415_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/62f33536-9ee8-4884-98e0-7a30513762ec.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:43 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117583759, 'registration': 'LB66AVM', 'account': 'STE093', 'make': 'BMW', 'model': '3 SERIES GRAN TURISMO DIESEL HATCHBACK', 'derivative': '335d xDrive M Sport 5dr Step Auto [Business Media]', 'mileage': 48944, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-11-30', 'fuel': 'Diesel', 'motExpiry': '2026-01-26', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LB66AVM/2025-12-01/image/b387e301-c92b-44ff-b393-3ede44830b6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/1ee2b024-5002-4147-a8a5-1a6d9addde23_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/059e3e4d-3359-4fb7-97b2-ec35a2823d89_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/ca952cdc-1ef5-4030-b8ee-8ad926443e33_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/c233feda-fb26-4c8f-9198-1b3402a634ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/1edf8ba4-345d-4c2c-a13c-c588b2af83ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/f917434e-1f34-4d80-9d4e-dc94bd53757e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/09dd2531-a177-4090-b146-39b989553254_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/3bad41e8-555c-4d01-9e08-c58d2065170f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/eb36ef3d-ad39-4952-9e2f-d2cd6c843415_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/62f33536-9ee8-4884-98e0-7a30513762ec.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91e3816c-1299-58c7-b5f9-71f70184e072 with identifier: 117583759
2025-12-01 19:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91e3816c-1299-58c7-b5f9-71f70184e072 with scrape type 1
2025-12-01 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 91e3816c-1299-58c7-b5f9-71f70184e072
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB66AVM%252F2025-12-01%252Fimage%252Fb387e301-c92b-44ff-b393-3ede44830b6d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB66AVM/2025-12-01/image/b387e301-c92b-44ff-b393-3ede44830b6d_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:43 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117576078, 'registration': 'LV22BSX', 'account': 'MER167', 'make': 'MERCEDES-BENZ', 'model': 'GLA HATCHBACK', 'derivative': 'GLA 200 AMG Line Premium 5dr Auto', 'mileage': 13183, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-05-14', 'fuel': 'Petrol', 'motExpiry': '2026-05-13', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LV22BSX/2025-12-01/image/f67781b8-6a3a-4511-8d0b-db46a7bce23e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/b8be238b-5f38-46a9-9091-99911abefaeb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/05eb512c-813b-4e5d-95f5-fd51626b4ac5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/34efc721-5d09-4f98-8269-6cec7c402936_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/da2007e4-588b-48db-8e4f-baba97535507_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/efcd5959-e99a-4836-a568-d5de20943c2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/f2f44ac0-22c4-4e06-a4b0-8b2318e1aa31_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/121f1a1c-cae5-4087-8b77-142d917a6b27_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/fa3fb67b-dfcb-4a6f-ab35-4bfc8a31420a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/320ef761-bd02-47d6-b931-ef1f5cf97e6d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 8K', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': True, 'v5details': 'Here', 'co2': 153, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6a8050ce-df3b-48a8-9d20-ba1dfc7878c1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:43 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117576078, 'registration': 'LV22BSX', 'account': 'MER167', 'make': 'MERCEDES-BENZ', 'model': 'GLA HATCHBACK', 'derivative': 'GLA 200 AMG Line Premium 5dr Auto', 'mileage': 13183, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-05-14', 'fuel': 'Petrol', 'motExpiry': '2026-05-13', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LV22BSX/2025-12-01/image/f67781b8-6a3a-4511-8d0b-db46a7bce23e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/b8be238b-5f38-46a9-9091-99911abefaeb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/05eb512c-813b-4e5d-95f5-fd51626b4ac5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/34efc721-5d09-4f98-8269-6cec7c402936_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/da2007e4-588b-48db-8e4f-baba97535507_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/efcd5959-e99a-4836-a568-d5de20943c2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/f2f44ac0-22c4-4e06-a4b0-8b2318e1aa31_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/121f1a1c-cae5-4087-8b77-142d917a6b27_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/fa3fb67b-dfcb-4a6f-ab35-4bfc8a31420a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/320ef761-bd02-47d6-b931-ef1f5cf97e6d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 8K', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': True, 'v5details': 'Here', 'co2': 153, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6a8050ce-df3b-48a8-9d20-ba1dfc7878c1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49ea86bd-0188-543f-9dff-87dbf2d122aa with identifier: 117576078
2025-12-01 19:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49ea86bd-0188-543f-9dff-87dbf2d122aa with scrape type 1
2025-12-01 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 49ea86bd-0188-543f-9dff-87dbf2d122aa
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV22BSX%252F2025-12-01%252Fimage%252Ff67781b8-6a3a-4511-8d0b-db46a7bce23e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV22BSX/2025-12-01/image/f67781b8-6a3a-4511-8d0b-db46a7bce23e_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YR66YCG/2025-12-01/image/afda7eb8-81b8-4f72-bed3-c7f8c206c83a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117609015?view=catalogue)
2025-12-01 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WL19RLV/2025-12-01/image/4bcfea0b-3877-4b2b-911d-d7813da4fcd9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117632563?view=catalogue)
2025-12-01 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA19YRV/2025-12-01/image/b99607bd-63b7-4065-a0c5-dda5e31dee44_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117621114?view=catalogue)
2025-12-01 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WL19RLV/2025-12-01/image/61489502-b40d-4f40-95bf-8b4d75a802d2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117632563?view=catalogue)
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FET17TNV%252F2025-12-01%252Fimage%252Fe658696e-fe29-4266-9d14-4fafc4234d58_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET17TNV/2025-12-01/image/e658696e-fe29-4266-9d14-4fafc4234d58_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGC65DZW%252F2025-11-26%252Fimage%252F0aec4fc0-ccfe-45e3-8be1-16be96c04689_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GC65DZW/2025-11-26/image/0aec4fc0-ccfe-45e3-8be1-16be96c04689_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 547d852c-3964-53d0-a29b-7e0b93ff6074 with identifier: 117024415
2025-12-01 19:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 547d852c-3964-53d0-a29b-7e0b93ff6074 with identifier: 117024415
2025-12-01 19:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 547d852c-3964-53d0-a29b-7e0b93ff6074 with identifier: 117024415 to the API
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27547d852c-3964-53d0-a29b-7e0b93ff6074%27 HTTP/1.1" 200 None
2025-12-01 19:00:43 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 547d852c-3964-53d0-a29b-7e0b93ff6074: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:00:42 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117024415?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '547d852c-3964-53d0-a29b-7e0b93ff6074',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WD67EHW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117024415',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'FORD',
 'model': 'ECOSPORT HATCHBACK',
 'odometer': 57860,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-31',
 'seller_name': 'TCB Group - Prime',
 'title': 'FORD ECOSPORT HATCHBACK 1.0 EcoBoost 125 Zetec 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125 Zetec 5dr',
 'vin': None,
 'year': 2018}
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024415%27 HTTP/1.1" 200 None
2025-12-01 19:00:43 [astonbarclay.gb] INFO: Saving data for 117024415: {'auction_closing_time': 1764755100.0, 'created_time': 1762455713.642953, 'last_price_update_time': 1764615643.594977}
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117024415') HTTP/1.1" 204 0
2025-12-01 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DE17YWV/2025-12-01/image/983b7f49-2ec0-4f09-88d7-6da5e9dd26d8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117636439?view=catalogue)
2025-12-01 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DE17YWV/2025-12-01/image/c78ece7c-8885-46ad-ad9f-c930ca8c36cf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117636439?view=catalogue)
2025-12-01 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 117558044
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117558044%27 HTTP/1.1" 200 None
2025-12-01 19:00:43 [astonbarclay.gb] INFO: Scrape type for 117558044: 0
2025-12-01 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 117615464
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615464%27 HTTP/1.1" 200 None
2025-12-01 19:00:43 [astonbarclay.gb] INFO: Scrape type for 117615464: 0
2025-12-01 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 117640138
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117640138%27 HTTP/1.1" 200 None
2025-12-01 19:00:43 [astonbarclay.gb] INFO: Scrape type for 117640138: 1
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB66AVM%252F2025-12-01%252Fimage%252F1ee2b024-5002-4147-a8a5-1a6d9addde23_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB66AVM/2025-12-01/image/1ee2b024-5002-4147-a8a5-1a6d9addde23_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV22BSX%252F2025-12-01%252Fimage%252Fb8be238b-5f38-46a9-9091-99911abefaeb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV22BSX/2025-12-01/image/b8be238b-5f38-46a9-9091-99911abefaeb_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117549131?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117397605?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f384bd0>
2025-12-01 19:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89214aa6-43de-5869-9911-0711c93784fc/89214aa6-43de-5869-9911-0711c93784fc_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA19YRV%252F2025-12-01%252Fimage%252Fa8860e8a-3fb3-4c6e-93b3-dabae7aef4b9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19YRV/2025-12-01/image/a8860e8a-3fb3-4c6e-93b3-dabae7aef4b9_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 89214aa6-43de-5869-9911-0711c93784fc
2025-12-01 19:00:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f2aa010>
2025-12-01 19:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fc61c1e-27fc-5109-8c11-3436b81e5022/6fc61c1e-27fc-5109-8c11-3436b81e5022_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDE17YWV%252F2025-12-01%252Fimage%252Fceac24e4-53c0-48f2-be99-91fb0dc82a3b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE17YWV/2025-12-01/image/ceac24e4-53c0-48f2-be99-91fb0dc82a3b_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6fc61c1e-27fc-5109-8c11-3436b81e5022
2025-12-01 19:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA19YRV/2025-12-01/image/b75c6da1-844f-4784-bf20-81735ae1911d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117621114?view=catalogue)
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FET17TNV%252F2025-12-01%252Fimage%252Fa23519b1-141a-489d-8ae3-066427c44f25_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET17TNV/2025-12-01/image/a23519b1-141a-489d-8ae3-066427c44f25_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGC65DZW%252F2025-11-26%252Fimage%252Fa07d8dde-542c-4e65-a443-d6de9c812000_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GC65DZW/2025-11-26/image/a07d8dde-542c-4e65-a443-d6de9c812000_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:44 [astonbarclay.gb] INFO: Found listing with ID: 117615588
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615588%27 HTTP/1.1" 200 None
2025-12-01 19:00:44 [astonbarclay.gb] INFO: Scrape type for 117615588: 0
2025-12-01 19:00:44 [astonbarclay.gb] INFO: Found listing with ID: 117590132
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117590132%27 HTTP/1.1" 200 None
2025-12-01 19:00:44 [astonbarclay.gb] INFO: Scrape type for 117590132: 0
2025-12-01 19:00:44 [astonbarclay.gb] INFO: Found listing with ID: 117514806
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117514806%27 HTTP/1.1" 200 None
2025-12-01 19:00:44 [astonbarclay.gb] INFO: Scrape type for 117514806: 0
2025-12-01 19:00:44 [astonbarclay.gb] INFO: Found listing with ID: 116802225
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116802225%27 HTTP/1.1" 200 None
2025-12-01 19:00:44 [astonbarclay.gb] INFO: Scrape type for 116802225: 0
2025-12-01 19:00:44 [astonbarclay.gb] INFO: Found listing with ID: 117399593
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117399593%27 HTTP/1.1" 200 None
2025-12-01 19:00:44 [astonbarclay.gb] INFO: Scrape type for 117399593: 0
2025-12-01 19:00:44 [astonbarclay.gb] INFO: Found listing with ID: 117615900
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615900%27 HTTP/1.1" 200 None
2025-12-01 19:00:44 [astonbarclay.gb] INFO: Scrape type for 117615900: 0
2025-12-01 19:00:44 [astonbarclay.gb] INFO: Found listing with ID: 117616040
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117616040%27 HTTP/1.1" 200 None
2025-12-01 19:00:44 [astonbarclay.gb] INFO: Scrape type for 117616040: 0
2025-12-01 19:00:44 [astonbarclay.gb] INFO: Found listing with ID: 117514835
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117514835%27 HTTP/1.1" 200 None
2025-12-01 19:00:44 [astonbarclay.gb] INFO: Scrape type for 117514835: 0
2025-12-01 19:00:44 [astonbarclay.gb] INFO: Found listing with ID: 117514787
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117514787%27 HTTP/1.1" 200 None
2025-12-01 19:00:44 [astonbarclay.gb] INFO: Scrape type for 117514787: 0
2025-12-01 19:00:44 [astonbarclay.gb] INFO: Found listing with ID: 117616319
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117616319%27 HTTP/1.1" 200 None
2025-12-01 19:00:44 [astonbarclay.gb] INFO: Scrape type for 117616319: 1
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB66AVM%252F2025-12-01%252Fimage%252F059e3e4d-3359-4fb7-97b2-ec35a2823d89_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB66AVM/2025-12-01/image/059e3e4d-3359-4fb7-97b2-ec35a2823d89_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV22BSX%252F2025-12-01%252Fimage%252F05eb512c-813b-4e5d-95f5-fd51626b4ac5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV22BSX/2025-12-01/image/05eb512c-813b-4e5d-95f5-fd51626b4ac5_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e75ba90>
2025-12-01 19:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_806e8254-da45-58a2-9827-dc16cca75b5c/806e8254-da45-58a2-9827-dc16cca75b5c_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYR66YCG%252F2025-12-01%252Fimage%252Fafda7eb8-81b8-4f72-bed3-c7f8c206c83a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YR66YCG/2025-12-01/image/afda7eb8-81b8-4f72-bed3-c7f8c206c83a_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 806e8254-da45-58a2-9827-dc16cca75b5c
2025-12-01 19:00:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 806e8254-da45-58a2-9827-dc16cca75b5c, skipping ID generation
2025-12-01 19:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 806e8254-da45-58a2-9827-dc16cca75b5c with scrape type 1
2025-12-01 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 806e8254-da45-58a2-9827-dc16cca75b5c from tracking dictionaries
2025-12-01 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 806e8254-da45-58a2-9827-dc16cca75b5c sending to next pipeline
2025-12-01 19:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 806e8254-da45-58a2-9827-dc16cca75b5c, identifier: 117609015
2025-12-01 19:00:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f3ab0d0>
2025-12-01 19:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315a462f-b1fb-5767-99b3-d3e45f95653b/315a462f-b1fb-5767-99b3-d3e45f95653b_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWL19RLV%252F2025-12-01%252Fimage%252F4bcfea0b-3877-4b2b-911d-d7813da4fcd9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WL19RLV/2025-12-01/image/4bcfea0b-3877-4b2b-911d-d7813da4fcd9_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 315a462f-b1fb-5767-99b3-d3e45f95653b
2025-12-01 19:00:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e77f290>
2025-12-01 19:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89214aa6-43de-5869-9911-0711c93784fc/89214aa6-43de-5869-9911-0711c93784fc_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA19YRV%252F2025-12-01%252Fimage%252Fb99607bd-63b7-4065-a0c5-dda5e31dee44_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19YRV/2025-12-01/image/b99607bd-63b7-4065-a0c5-dda5e31dee44_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 89214aa6-43de-5869-9911-0711c93784fc
2025-12-01 19:00:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e791390>
2025-12-01 19:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315a462f-b1fb-5767-99b3-d3e45f95653b/315a462f-b1fb-5767-99b3-d3e45f95653b_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWL19RLV%252F2025-12-01%252Fimage%252F61489502-b40d-4f40-95bf-8b4d75a802d2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WL19RLV/2025-12-01/image/61489502-b40d-4f40-95bf-8b4d75a802d2_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 315a462f-b1fb-5767-99b3-d3e45f95653b
2025-12-01 19:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GC65DZW/2025-11-26/image/2ad9e4a6-212a-4eb3-b8dd-1f3826fa4ac4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117495142?view=catalogue)
2025-12-01 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FET17TNV%252F2025-12-01%252Fimage%252F5f65e192-02f6-46c1-86c7-b818124a8eca_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET17TNV/2025-12-01/image/5f65e192-02f6-46c1-86c7-b818124a8eca_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGC65DZW%252F2025-11-26%252Fimage%252Fec6e9e30-66ba-4173-a850-9625294d9298_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GC65DZW/2025-11-26/image/ec6e9e30-66ba-4173-a850-9625294d9298_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 806e8254-da45-58a2-9827-dc16cca75b5c with identifier: 117609015
2025-12-01 19:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 806e8254-da45-58a2-9827-dc16cca75b5c with identifier: 117609015
2025-12-01 19:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 806e8254-da45-58a2-9827-dc16cca75b5c with identifier: 117609015 to the API
2025-12-01 19:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YR66YCG/2025-12-01/image/afda7eb8-81b8-4f72-bed3-c7f8c206c83a_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-02T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '806e8254-da45-58a2-9827-dc16cca75b5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YR66YCG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117609015',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'AUDI',
 'model': 'A6 DIESEL SALOON',
 'odometer': 68767,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_806e8254-da45-58a2-9827-dc16cca75b5c/806e8254-da45-58a2-9827-dc16cca75b5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29866,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YR66YCG/2025-12-01/image/cc49f354-c540-4000-bb15-d5dc11dc8098_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_806e8254-da45-58a2-9827-dc16cca75b5c/806e8254-da45-58a2-9827-dc16cca75b5c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27576,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YR66YCG/2025-12-01/image/afda7eb8-81b8-4f72-bed3-c7f8c206c83a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_806e8254-da45-58a2-9827-dc16cca75b5c/806e8254-da45-58a2-9827-dc16cca75b5c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28411,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YR66YCG/2025-12-01/image/d6c3dea5-047b-443e-8428-99ebeb8bbe36_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_806e8254-da45-58a2-9827-dc16cca75b5c/806e8254-da45-58a2-9827-dc16cca75b5c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25733,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YR66YCG/2025-12-01/image/63f13649-bbea-4df9-bd58-9089925d3ae6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_806e8254-da45-58a2-9827-dc16cca75b5c/806e8254-da45-58a2-9827-dc16cca75b5c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45242,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YR66YCG/2025-12-01/image/c5931db0-1018-4af3-830a-5cb191d14c39_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_806e8254-da45-58a2-9827-dc16cca75b5c/806e8254-da45-58a2-9827-dc16cca75b5c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51328,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YR66YCG/2025-12-01/image/c7105256-bcd1-4d20-8846-5f0fe0d1d477_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_806e8254-da45-58a2-9827-dc16cca75b5c/806e8254-da45-58a2-9827-dc16cca75b5c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49365,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YR66YCG/2025-12-01/image/1416b83a-0a0d-4e37-b01d-8a7e38bc0040_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_806e8254-da45-58a2-9827-dc16cca75b5c/806e8254-da45-58a2-9827-dc16cca75b5c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48613,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YR66YCG/2025-12-01/image/0c12bf38-d294-4916-af8c-afb2632f1339_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-30',
 'seller_name': 'Dace',
 'title': 'AUDI A6 DIESEL SALOON 2.0 TDI Quattro SE Executive 4dr S Tronic',
 'transmission': 'automatic',
 'trim': '2.0 TDI Quattro SE Executive 4dr S Tronic',
 'vin': None,
 'year': 2016}
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117609015%27 HTTP/1.1" 200 None
2025-12-01 19:00:46 [astonbarclay.gb] INFO: Saving data for 117609015: {'created_time': 1764615646.144963, 'last_price_update_time': 1764615646.144973, 'auction_closing_time': 1764669600.0}
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117609015') HTTP/1.1" 204 0
2025-12-01 19:00:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f50646d88d0>
2025-12-01 19:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fc61c1e-27fc-5109-8c11-3436b81e5022/6fc61c1e-27fc-5109-8c11-3436b81e5022_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDE17YWV%252F2025-12-01%252Fimage%252F983b7f49-2ec0-4f09-88d7-6da5e9dd26d8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE17YWV/2025-12-01/image/983b7f49-2ec0-4f09-88d7-6da5e9dd26d8_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6fc61c1e-27fc-5109-8c11-3436b81e5022
2025-12-01 19:00:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f2e9310>
2025-12-01 19:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fc61c1e-27fc-5109-8c11-3436b81e5022/6fc61c1e-27fc-5109-8c11-3436b81e5022_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDE17YWV%252F2025-12-01%252Fimage%252Fc78ece7c-8885-46ad-ad9f-c930ca8c36cf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE17YWV/2025-12-01/image/c78ece7c-8885-46ad-ad9f-c930ca8c36cf_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6fc61c1e-27fc-5109-8c11-3436b81e5022
2025-12-01 19:00:46 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117549131, 'registration': 'LV71RCF', 'account': 'MER167', 'make': 'MERCEDES-BENZ', 'model': 'GLB ESTATE', 'derivative': 'GLB 200 AMG Line 5dr 7G-Tronic', 'mileage': 33401, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-10', 'fuel': 'Petrol', 'motExpiry': '2025-12-09', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LV71RCF/2025-12-01/image/0ca52801-ecac-4485-bab6-adbec70ab718_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RCF/2025-12-01/image/c61f9146-bf8a-4c1d-b2d7-5dfe9ad7657b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RCF/2025-12-01/image/34508758-cdd5-42a8-9bf4-6131df3267eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RCF/2025-12-01/image/809d4590-4293-4d42-b8ed-66bc39ba6e76_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RCF/2025-12-01/image/a84153f4-202b-4257-9620-1d034021001f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RCF/2025-12-01/image/0aa2e920-125f-4c72-9656-f0bd3074991e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RCF/2025-12-01/image/1a733e35-3dcc-4a34-b15a-d1e7d2dc866b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RCF/2025-12-01/image/5a662e02-9baa-4209-b786-b4816d697f1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RCF/2025-12-01/image/cf1d424d-c51c-4533-bfd8-29af3f745ec4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RCF/2025-12-01/image/30d580c3-ef46-410b-bb0f-8511444dffb4_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/22-10K 12/23-18K 11/24-26K', 'remarks': 'VOSA STATES 26K', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': True, 'v5details': 'Here', 'co2': 163, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b87e6d51-6d1c-42de-a761-19234481dc51.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:46 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117549131, 'registration': 'LV71RCF', 'account': 'MER167', 'make': 'MERCEDES-BENZ', 'model': 'GLB ESTATE', 'derivative': 'GLB 200 AMG Line 5dr 7G-Tronic', 'mileage': 33401, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-12-10', 'fuel': 'Petrol', 'motExpiry': '2025-12-09', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LV71RCF/2025-12-01/image/0ca52801-ecac-4485-bab6-adbec70ab718_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RCF/2025-12-01/image/c61f9146-bf8a-4c1d-b2d7-5dfe9ad7657b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RCF/2025-12-01/image/34508758-cdd5-42a8-9bf4-6131df3267eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RCF/2025-12-01/image/809d4590-4293-4d42-b8ed-66bc39ba6e76_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RCF/2025-12-01/image/a84153f4-202b-4257-9620-1d034021001f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RCF/2025-12-01/image/0aa2e920-125f-4c72-9656-f0bd3074991e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RCF/2025-12-01/image/1a733e35-3dcc-4a34-b15a-d1e7d2dc866b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RCF/2025-12-01/image/5a662e02-9baa-4209-b786-b4816d697f1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RCF/2025-12-01/image/cf1d424d-c51c-4533-bfd8-29af3f745ec4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV71RCF/2025-12-01/image/30d580c3-ef46-410b-bb0f-8511444dffb4_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/22-10K 12/23-18K 11/24-26K', 'remarks': 'VOSA STATES 26K', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': True, 'v5details': 'Here', 'co2': 163, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b87e6d51-6d1c-42de-a761-19234481dc51.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c28ca92-e6d5-5e58-b0d2-611709a3df7b with identifier: 117549131
2025-12-01 19:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c28ca92-e6d5-5e58-b0d2-611709a3df7b with scrape type 1
2025-12-01 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c28ca92-e6d5-5e58-b0d2-611709a3df7b
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV71RCF%252F2025-12-01%252Fimage%252F0ca52801-ecac-4485-bab6-adbec70ab718_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV71RCF/2025-12-01/image/0ca52801-ecac-4485-bab6-adbec70ab718_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:46 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117397605, 'registration': 'RV72YYE', 'account': 'DAY005', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 39662, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-09-16', 'fuel': 'Diesel', 'motExpiry': '2026-09-15', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RV72YYE/2025-11-24/image/af201da6-9ef9-439b-aefd-1ddf604d603b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/4dfdc7fe-8269-469e-bab9-084c98cff8d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/112051d6-6ad0-4050-a40e-d5414020d68d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/9d71a631-3046-4c48-b97a-33e1c0cd119d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/a4761cfc-8d26-495e-9477-eafc2bf5a1bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/e03b3775-d6b7-4366-b406-c9d498b7120f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/40962408-0249-417b-8737-45063378cee9_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/e189b0c5-ae4f-449c-bde8-f1567c0d0b35_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/a91b4f09-9f7c-4531-a084-684ca6a7628a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/b3115f3e-fe2c-4113-9bdb-bdb2e9cc5f74_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/25-29K', 'remarks': '', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fe1dae54-0e79-4292-b064-51eb2123224a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-01 19:00:46 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117397605, 'registration': 'RV72YYE', 'account': 'DAY005', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 39662, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-09-16', 'fuel': 'Diesel', 'motExpiry': '2026-09-15', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RV72YYE/2025-11-24/image/af201da6-9ef9-439b-aefd-1ddf604d603b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/4dfdc7fe-8269-469e-bab9-084c98cff8d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/112051d6-6ad0-4050-a40e-d5414020d68d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/9d71a631-3046-4c48-b97a-33e1c0cd119d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/a4761cfc-8d26-495e-9477-eafc2bf5a1bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/e03b3775-d6b7-4366-b406-c9d498b7120f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/40962408-0249-417b-8737-45063378cee9_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/e189b0c5-ae4f-449c-bde8-f1567c0d0b35_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/a91b4f09-9f7c-4531-a084-684ca6a7628a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV72YYE/2025-11-24/image/b3115f3e-fe2c-4113-9bdb-bdb2e9cc5f74_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/25-29K', 'remarks': '', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fe1dae54-0e79-4292-b064-51eb2123224a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-01 19:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 991f7e6d-3eb0-5486-a3f0-5fc9070ec6cb with identifier: 117397605
2025-12-01 19:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 991f7e6d-3eb0-5486-a3f0-5fc9070ec6cb with scrape type 2
2025-12-01 19:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 991f7e6d-3eb0-5486-a3f0-5fc9070ec6cb with scrape type 2
2025-12-01 19:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 991f7e6d-3eb0-5486-a3f0-5fc9070ec6cb, identifier: 117397605
2025-12-01 19:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ET17TNV/2025-12-01/image/c2749c85-11d6-4b3d-9254-e58ccdbd81e3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117596913?view=catalogue)
2025-12-01 19:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WL19RLV/2025-12-01/image/f0166b53-82f4-4b4b-aef1-7df1a130b02d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117632563?view=catalogue)
2025-12-01 19:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV22BSX/2025-12-01/image/f67781b8-6a3a-4511-8d0b-db46a7bce23e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117576078?view=catalogue)
2025-12-01 19:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB66AVM/2025-12-01/image/b387e301-c92b-44ff-b393-3ede44830b6d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117583759?view=catalogue)
2025-12-01 19:00:46 [astonbarclay.gb] INFO: Found listing with ID: 117576471
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576471%27 HTTP/1.1" 200 None
2025-12-01 19:00:46 [astonbarclay.gb] INFO: Scrape type for 117576471: 0
2025-12-01 19:00:46 [astonbarclay.gb] INFO: Found listing with ID: 117474004
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117474004%27 HTTP/1.1" 200 None
2025-12-01 19:00:46 [astonbarclay.gb] INFO: Scrape type for 117474004: 0
2025-12-01 19:00:46 [astonbarclay.gb] INFO: Found listing with ID: 117576508
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576508%27 HTTP/1.1" 200 None
2025-12-01 19:00:46 [astonbarclay.gb] INFO: Scrape type for 117576508: 0
2025-12-01 19:00:46 [astonbarclay.gb] INFO: Found listing with ID: 117077436
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117077436%27 HTTP/1.1" 200 None
2025-12-01 19:00:46 [astonbarclay.gb] INFO: Scrape type for 117077436: 0
2025-12-01 19:00:46 [astonbarclay.gb] INFO: Found listing with ID: 117576494
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576494%27 HTTP/1.1" 200 None
2025-12-01 19:00:46 [astonbarclay.gb] INFO: Scrape type for 117576494: 0
2025-12-01 19:00:46 [astonbarclay.gb] INFO: Found listing with ID: 117609113
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117609113%27 HTTP/1.1" 200 None
2025-12-01 19:00:47 [astonbarclay.gb] INFO: Scrape type for 117609113: 0
2025-12-01 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 117576544
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576544%27 HTTP/1.1" 200 None
2025-12-01 19:00:47 [astonbarclay.gb] INFO: Scrape type for 117576544: 0
2025-12-01 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 117262074
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117262074%27 HTTP/1.1" 200 None
2025-12-01 19:00:47 [astonbarclay.gb] INFO: Scrape type for 117262074: 1
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB66AVM%252F2025-12-01%252Fimage%252Fca952cdc-1ef5-4030-b8ee-8ad926443e33_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB66AVM/2025-12-01/image/ca952cdc-1ef5-4030-b8ee-8ad926443e33_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV22BSX%252F2025-12-01%252Fimage%252F34efc721-5d09-4f98-8269-6cec7c402936_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV22BSX/2025-12-01/image/34efc721-5d09-4f98-8269-6cec7c402936_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 991f7e6d-3eb0-5486-a3f0-5fc9070ec6cb with identifier: 117397605
2025-12-01 19:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 991f7e6d-3eb0-5486-a3f0-5fc9070ec6cb with identifier: 117397605
2025-12-01 19:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 991f7e6d-3eb0-5486-a3f0-5fc9070ec6cb with identifier: 117397605 to the API
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27991f7e6d-3eb0-5486-a3f0-5fc9070ec6cb%27 HTTP/1.1" 200 None
2025-12-01 19:00:47 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 991f7e6d-3eb0-5486-a3f0-5fc9070ec6cb: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:00:46 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117397605?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '991f7e6d-3eb0-5486-a3f0-5fc9070ec6cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'RV72YYE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117397605',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF DIESEL HATCHBACK',
 'odometer': 39662,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-16',
 'seller_name': 'Days Fleet',
 'title': 'VOLKSWAGEN GOLF DIESEL HATCHBACK 2.0 TDI Life 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI Life 5dr',
 'vin': None,
 'year': 2022}
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117397605%27 HTTP/1.1" 200 None
2025-12-01 19:00:47 [astonbarclay.gb] INFO: Saving data for 117397605: {'auction_closing_time': 1764756000.0, 'created_time': 1763751833.796632, 'last_price_update_time': 1764615647.336271}
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117397605') HTTP/1.1" 204 0
2025-12-01 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GC65DZW/2025-11-26/image/0aec4fc0-ccfe-45e3-8be1-16be96c04689_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117495142?view=catalogue)
2025-12-01 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ET17TNV/2025-12-01/image/e658696e-fe29-4266-9d14-4fafc4234d58_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117596913?view=catalogue)
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FET17TNV%252F2025-12-01%252Fimage%252F9af11aa6-f189-488f-8341-502ca7506746_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET17TNV/2025-12-01/image/9af11aa6-f189-488f-8341-502ca7506746_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGC65DZW%252F2025-11-26%252Fimage%252Fa128af62-2e45-4fa6-8bf7-680f3eda5aa4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GC65DZW/2025-11-26/image/a128af62-2e45-4fa6-8bf7-680f3eda5aa4_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV71RCF%252F2025-12-01%252Fimage%252Fc61f9146-bf8a-4c1d-b2d7-5dfe9ad7657b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV71RCF/2025-12-01/image/c61f9146-bf8a-4c1d-b2d7-5dfe9ad7657b_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117207188?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117549150?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117207172?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117002721?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117583554?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117563502?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f50643e8d50>
2025-12-01 19:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89214aa6-43de-5869-9911-0711c93784fc/89214aa6-43de-5869-9911-0711c93784fc_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA19YRV%252F2025-12-01%252Fimage%252Fb75c6da1-844f-4784-bf20-81735ae1911d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19YRV/2025-12-01/image/b75c6da1-844f-4784-bf20-81735ae1911d_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 89214aa6-43de-5869-9911-0711c93784fc
2025-12-01 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 117576566
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576566%27 HTTP/1.1" 200 None
2025-12-01 19:00:47 [astonbarclay.gb] INFO: Scrape type for 117576566: 0
2025-12-01 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 117579407
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117579407%27 HTTP/1.1" 200 None
2025-12-01 19:00:47 [astonbarclay.gb] INFO: Scrape type for 117579407: 0
2025-12-01 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 117590193
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117590193%27 HTTP/1.1" 200 None
2025-12-01 19:00:47 [astonbarclay.gb] INFO: Scrape type for 117590193: 0
2025-12-01 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 117580534
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117580534%27 HTTP/1.1" 200 None
2025-12-01 19:00:47 [astonbarclay.gb] INFO: Scrape type for 117580534: 0
2025-12-01 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 117545534
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117545534%27 HTTP/1.1" 200 None
2025-12-01 19:00:47 [astonbarclay.gb] INFO: Scrape type for 117545534: 1
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB66AVM%252F2025-12-01%252Fimage%252Fc233feda-fb26-4c8f-9198-1b3402a634ca_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB66AVM/2025-12-01/image/c233feda-fb26-4c8f-9198-1b3402a634ca_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV22BSX%252F2025-12-01%252Fimage%252Fda2007e4-588b-48db-8e4f-baba97535507_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV22BSX/2025-12-01/image/da2007e4-588b-48db-8e4f-baba97535507_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:00:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e881f10>
2025-12-01 19:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41a9bad-985b-5457-94ae-8b214ecf4c78/a41a9bad-985b-5457-94ae-8b214ecf4c78_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGC65DZW%252F2025-11-26%252Fimage%252F2ad9e4a6-212a-4eb3-b8dd-1f3826fa4ac4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GC65DZW/2025-11-26/image/2ad9e4a6-212a-4eb3-b8dd-1f3826fa4ac4_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a41a9bad-985b-5457-94ae-8b214ecf4c78
2025-12-01 19:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GC65DZW/2025-11-26/image/a07d8dde-542c-4e65-a443-d6de9c812000_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117495142?view=catalogue)
2025-12-01 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FET17TNV%252F2025-12-01%252Fimage%252Fcdd6f396-36f2-47d7-875a-59e91c12d5ac_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET17TNV/2025-12-01/image/cdd6f396-36f2-47d7-875a-59e91c12d5ac_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGC65DZW%252F2025-11-26%252Fimage%252F7d8543f3-be50-4ffd-865d-e8a9f8cb2578_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GC65DZW/2025-11-26/image/7d8543f3-be50-4ffd-865d-e8a9f8cb2578_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV71RCF%252F2025-12-01%252Fimage%252F34508758-cdd5-42a8-9bf4-6131df3267eb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV71RCF/2025-12-01/image/34508758-cdd5-42a8-9bf4-6131df3267eb_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f2043d0>
2025-12-01 19:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-01 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7553a85-b1d7-5800-8c41-acd80624ea68/c7553a85-b1d7-5800-8c41-acd80624ea68_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FET17TNV%252F2025-12-01%252Fimage%252Fc2749c85-11d6-4b3d-9254-e58ccdbd81e3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET17TNV/2025-12-01/image/c2749c85-11d6-4b3d-9254-e58ccdbd81e3_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c7553a85-b1d7-5800-8c41-acd80624ea68
2025-12-01 19:00:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6b4d90>
2025-12-01 19:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315a462f-b1fb-5767-99b3-d3e45f95653b/315a462f-b1fb-5767-99b3-d3e45f95653b_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWL19RLV%252F2025-12-01%252Fimage%252Ff0166b53-82f4-4b4b-aef1-7df1a130b02d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WL19RLV/2025-12-01/image/f0166b53-82f4-4b4b-aef1-7df1a130b02d_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 315a462f-b1fb-5767-99b3-d3e45f95653b
2025-12-01 19:00:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6aca10>
2025-12-01 19:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49ea86bd-0188-543f-9dff-87dbf2d122aa/49ea86bd-0188-543f-9dff-87dbf2d122aa_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV22BSX%252F2025-12-01%252Fimage%252Ff67781b8-6a3a-4511-8d0b-db46a7bce23e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV22BSX/2025-12-01/image/f67781b8-6a3a-4511-8d0b-db46a7bce23e_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49ea86bd-0188-543f-9dff-87dbf2d122aa
2025-12-01 19:00:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6b40d0>
2025-12-01 19:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91e3816c-1299-58c7-b5f9-71f70184e072/91e3816c-1299-58c7-b5f9-71f70184e072_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB66AVM%252F2025-12-01%252Fimage%252Fb387e301-c92b-44ff-b393-3ede44830b6d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB66AVM/2025-12-01/image/b387e301-c92b-44ff-b393-3ede44830b6d_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 91e3816c-1299-58c7-b5f9-71f70184e072
2025-12-01 19:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV22BSX/2025-12-01/image/05eb512c-813b-4e5d-95f5-fd51626b4ac5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117576078?view=catalogue)
2025-12-01 19:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ET17TNV/2025-12-01/image/a23519b1-141a-489d-8ae3-066427c44f25_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117596913?view=catalogue)
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117085617
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117085617%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117085617: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117058987
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117058987%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117058987: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117329064
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117329064%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117329064: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117277530
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117277530%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117277530: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117242484
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117242484%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117242484: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 116833742
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116833742%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 116833742: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117069859
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117069859%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117069859: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117140776
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117140776%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117140776: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117407917
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407917%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117407917: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 116280997
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116280997%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 116280997: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117085521
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117085521%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117085521: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117209040
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117209040%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117209040: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 116699879
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116699879%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 116699879: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117369086
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117369086%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117369086: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117256307
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117256307%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117256307: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 116772841
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116772841%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 116772841: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117364404
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117364404%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117364404: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117422017
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117422017%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117422017: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117099256
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117099256%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117099256: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 116361929
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116361929%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 116361929: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117178728
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117178728%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117178728: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 116963745
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116963745%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 116963745: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 116666877
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116666877%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 116666877: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117099210
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117099210%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117099210: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 116183620
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116183620%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 116183620: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117262801
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117262801%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117262801: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117235504
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117235504%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117235504: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117424159
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117424159%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117424159: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117101358
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117101358%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117101358: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 116941457
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116941457%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 116941457: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117364152
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117364152%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117364152: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117264969
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117264969%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117264969: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117308707
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117308707%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117308707: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117058008
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117058008%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117058008: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117024845
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024845%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117024845: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 116560193
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116560193%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 116560193: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117402247
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117402247%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117402247: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117402830
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117402830%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117402830: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117584319
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584319%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117584319: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117584272
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584272%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117584272: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117495085
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117495085%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117495085: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117495107
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117495107%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117495107: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117495054
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117495054%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117495054: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117495072
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117495072%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117495072: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117584261
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584261%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117584261: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117517710
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517710%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117517710: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117099421
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117099421%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117099421: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117517733
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517733%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117517733: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117517631
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517631%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117517631: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117517722
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517722%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117517722: 0
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Found listing with ID: 117418998
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117418998%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117418998: 1
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB66AVM%252F2025-12-01%252Fimage%252F1edf8ba4-345d-4c2c-a13c-c588b2af83ce_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB66AVM/2025-12-01/image/1edf8ba4-345d-4c2c-a13c-c588b2af83ce_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV22BSX%252F2025-12-01%252Fimage%252Fefcd5959-e99a-4836-a568-d5de20943c2b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV22BSX/2025-12-01/image/efcd5959-e99a-4836-a568-d5de20943c2b_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f50643eb890>
2025-12-01 19:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41a9bad-985b-5457-94ae-8b214ecf4c78/a41a9bad-985b-5457-94ae-8b214ecf4c78_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGC65DZW%252F2025-11-26%252Fimage%252F0aec4fc0-ccfe-45e3-8be1-16be96c04689_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GC65DZW/2025-11-26/image/0aec4fc0-ccfe-45e3-8be1-16be96c04689_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a41a9bad-985b-5457-94ae-8b214ecf4c78
2025-12-01 19:00:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e5530d0>
2025-12-01 19:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7553a85-b1d7-5800-8c41-acd80624ea68/c7553a85-b1d7-5800-8c41-acd80624ea68_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FET17TNV%252F2025-12-01%252Fimage%252Fe658696e-fe29-4266-9d14-4fafc4234d58_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET17TNV/2025-12-01/image/e658696e-fe29-4266-9d14-4fafc4234d58_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c7553a85-b1d7-5800-8c41-acd80624ea68
2025-12-01 19:00:50 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117207188, 'registration': 'BU21HYC', 'account': 'AST002', 'make': 'JEEP', 'model': 'RENEGADE HATCHBACK SPECIAL EDITION', 'derivative': '1.0 T3 GSE Night Eagle II 5dr', 'mileage': 21876, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2021-03-17', 'fuel': 'Petrol', 'motExpiry': '2025-01-22', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BU21HYC/2025-11-18/image/e5c75224-a802-435f-b578-43508d0d9506_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/f2246be3-a9a6-496e-8c3d-5276412848e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/868263ca-69d0-413f-b361-6faa173d1a1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/9687693f-f640-455e-992b-fb7c63681dff_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/9f51af8f-617f-4146-acd0-f946bc471cfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/82262a13-56d8-432a-bc7f-d520bca1776b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/d8f211c2-7bc0-4e94-b841-5d3006565666_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/ac0761ea-9300-4a59-90e6-9cc6cc027e5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/9fafc760-c61d-413b-9f99-67501b31c105_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/356e5c26-9467-4311-96b3-daa734bae976_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 03/22-5k,  02/23-11k,  01/24-18k', 'remarks': '**STARTS & RUNS BUT INTERMITTEN EML ILLUMINATED - MAY HAVE FURTHER FAULTS - COLLECTION ONLY - NO DELIVERY AVAILABLE - VEHICLE LOCATED IN CHELMSFORD, ESSEX** - SPARE KEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 152, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a929741f-2f35-43d3-a9cb-28dda0f6780c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:50 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117207188, 'registration': 'BU21HYC', 'account': 'AST002', 'make': 'JEEP', 'model': 'RENEGADE HATCHBACK SPECIAL EDITION', 'derivative': '1.0 T3 GSE Night Eagle II 5dr', 'mileage': 21876, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2021-03-17', 'fuel': 'Petrol', 'motExpiry': '2025-01-22', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BU21HYC/2025-11-18/image/e5c75224-a802-435f-b578-43508d0d9506_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/f2246be3-a9a6-496e-8c3d-5276412848e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/868263ca-69d0-413f-b361-6faa173d1a1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/9687693f-f640-455e-992b-fb7c63681dff_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/9f51af8f-617f-4146-acd0-f946bc471cfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/82262a13-56d8-432a-bc7f-d520bca1776b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/d8f211c2-7bc0-4e94-b841-5d3006565666_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/ac0761ea-9300-4a59-90e6-9cc6cc027e5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/9fafc760-c61d-413b-9f99-67501b31c105_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/356e5c26-9467-4311-96b3-daa734bae976_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 03/22-5k,  02/23-11k,  01/24-18k', 'remarks': '**STARTS & RUNS BUT INTERMITTEN EML ILLUMINATED - MAY HAVE FURTHER FAULTS - COLLECTION ONLY - NO DELIVERY AVAILABLE - VEHICLE LOCATED IN CHELMSFORD, ESSEX** - SPARE KEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 152, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a929741f-2f35-43d3-a9cb-28dda0f6780c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e3e9c6c-f246-5405-ac96-76e6a1737954 with identifier: 117207188
2025-12-01 19:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e3e9c6c-f246-5405-ac96-76e6a1737954 with scrape type 2
2025-12-01 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e3e9c6c-f246-5405-ac96-76e6a1737954 with scrape type 2
2025-12-01 19:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0e3e9c6c-f246-5405-ac96-76e6a1737954, identifier: 117207188
2025-12-01 19:00:50 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117549150, 'registration': 'EX20XCS', 'account': 'MER167', 'make': 'MERCEDES-BENZ', 'model': 'B CLASS DIESEL HATCHBACK', 'derivative': 'B200d AMG Line Premium 5dr Auto', 'mileage': 61683, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-03-19', 'fuel': 'Diesel', 'motExpiry': '2026-03-18', 'doors': 5, 'engineSize': 1950, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EX20XCS/2025-12-01/image/d64ecc6c-eee9-4d52-a826-69e6fb62a5e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/2299d1ed-3acf-4119-92ce-6411aefa8183_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/91491da4-8199-44f4-90b0-2d80f5f5a373_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/be057c18-49cf-4429-9c61-e5ca012cc4be_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/0f10db47-9ddd-45ff-86da-1fee84a2b99b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/05bb4e19-6169-4e76-a250-55b6df2a9397_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/49947d55-ecbb-492d-ac6d-d04877c6132d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/9718708b-b93c-4ca1-8b3a-8e1ab8f38740_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/c19aab74-26a0-4bff-bff0-d40950415a78_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/ea315940-8e43-49ec-9a90-f19bdbd26be1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/7b245dc6-60f8-42f7-b646-67b0d3916239_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/21-7K 03/22-17K 03/23-28K 03/24-39K 02/25-53K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 28K 39K 53K', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': True, 'v5details': 'Here', 'co2': 115, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/68a3642d-28a4-459e-b7eb-dd69861b91b1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:50 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117549150, 'registration': 'EX20XCS', 'account': 'MER167', 'make': 'MERCEDES-BENZ', 'model': 'B CLASS DIESEL HATCHBACK', 'derivative': 'B200d AMG Line Premium 5dr Auto', 'mileage': 61683, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-03-19', 'fuel': 'Diesel', 'motExpiry': '2026-03-18', 'doors': 5, 'engineSize': 1950, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EX20XCS/2025-12-01/image/d64ecc6c-eee9-4d52-a826-69e6fb62a5e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/2299d1ed-3acf-4119-92ce-6411aefa8183_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/91491da4-8199-44f4-90b0-2d80f5f5a373_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/be057c18-49cf-4429-9c61-e5ca012cc4be_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/0f10db47-9ddd-45ff-86da-1fee84a2b99b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/05bb4e19-6169-4e76-a250-55b6df2a9397_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/49947d55-ecbb-492d-ac6d-d04877c6132d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/9718708b-b93c-4ca1-8b3a-8e1ab8f38740_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/c19aab74-26a0-4bff-bff0-d40950415a78_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/ea315940-8e43-49ec-9a90-f19bdbd26be1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/7b245dc6-60f8-42f7-b646-67b0d3916239_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/21-7K 03/22-17K 03/23-28K 03/24-39K 02/25-53K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 28K 39K 53K', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': True, 'v5details': 'Here', 'co2': 115, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/68a3642d-28a4-459e-b7eb-dd69861b91b1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7800d3dd-b271-56f9-9c1d-5a1b4b402c50 with identifier: 117549150
2025-12-01 19:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7800d3dd-b271-56f9-9c1d-5a1b4b402c50 with scrape type 1
2025-12-01 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item 7800d3dd-b271-56f9-9c1d-5a1b4b402c50
2025-12-01 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX20XCS%252F2025-12-01%252Fimage%252Fd64ecc6c-eee9-4d52-a826-69e6fb62a5e5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX20XCS/2025-12-01/image/d64ecc6c-eee9-4d52-a826-69e6fb62a5e5_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:50 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117207172, 'registration': 'LP68KPL', 'account': 'AST002', 'make': 'HONDA', 'model': 'CR-V ESTATE', 'derivative': '1.5 VTEC Turbo SR 5dr', 'mileage': 66046, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-01-21', 'fuel': 'Petrol', 'motExpiry': '2026-02-16', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LP68KPL/2025-11-18/image/818c0937-a52a-4ead-b74f-7a340b4c9b4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/b3ecac5c-d76a-4609-ad45-6a9b745ed809_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/7993ee14-3934-4d82-a5cc-2b1a8ab270c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/478e66a8-0389-4321-8355-d9461ba23778_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/4427cadb-798b-45b7-ac11-0f8fe0780deb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/5771ba0e-d625-40e5-9f30-a3233047e8ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/245f69b9-724d-4eca-9e94-b9628cef4a88_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/9ec46779-9821-4bca-99df-29192a601705_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/b9ba36ce-e586-4a49-82d2-e9ceb5e08cf1_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**Intermittent EML - CHECK ASSURED REPORT - MAY HAVE FURTHER FAULTS - COLLECTION ONLY - NO DELIVERY AVAILABLE - VEHICLE LOCATED IN CHELMSFORD, ESSEX** - VOSA STATES, 40K, 48K, 55K, 63K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a5d6c9cb-3550-4ac2-b87a-9dd71fc34512.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:50 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117207172, 'registration': 'LP68KPL', 'account': 'AST002', 'make': 'HONDA', 'model': 'CR-V ESTATE', 'derivative': '1.5 VTEC Turbo SR 5dr', 'mileage': 66046, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-01-21', 'fuel': 'Petrol', 'motExpiry': '2026-02-16', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LP68KPL/2025-11-18/image/818c0937-a52a-4ead-b74f-7a340b4c9b4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/b3ecac5c-d76a-4609-ad45-6a9b745ed809_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/7993ee14-3934-4d82-a5cc-2b1a8ab270c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/478e66a8-0389-4321-8355-d9461ba23778_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/4427cadb-798b-45b7-ac11-0f8fe0780deb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/5771ba0e-d625-40e5-9f30-a3233047e8ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/245f69b9-724d-4eca-9e94-b9628cef4a88_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/9ec46779-9821-4bca-99df-29192a601705_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/b9ba36ce-e586-4a49-82d2-e9ceb5e08cf1_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**Intermittent EML - CHECK ASSURED REPORT - MAY HAVE FURTHER FAULTS - COLLECTION ONLY - NO DELIVERY AVAILABLE - VEHICLE LOCATED IN CHELMSFORD, ESSEX** - VOSA STATES, 40K, 48K, 55K, 63K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a5d6c9cb-3550-4ac2-b87a-9dd71fc34512.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92454ddf-1dc2-588e-b630-dd71f18ddd7a with identifier: 117207172
2025-12-01 19:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92454ddf-1dc2-588e-b630-dd71f18ddd7a with scrape type 2
2025-12-01 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92454ddf-1dc2-588e-b630-dd71f18ddd7a with scrape type 2
2025-12-01 19:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 92454ddf-1dc2-588e-b630-dd71f18ddd7a, identifier: 117207172
2025-12-01 19:00:50 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117002721, 'registration': 'HT19ODX', 'account': 'AST003', 'make': 'RENAULT', 'model': 'KADJAR HATCHBACK', 'derivative': '1.3 TCE Iconic 5dr', 'mileage': 66282, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-03-28', 'fuel': 'Petrol', 'motExpiry': '2026-08-21', 'doors': 5, 'engineSize': 1330, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HT19ODX/2025-11-12/image/44964eec-e4aa-4b80-aa15-61f416130649_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/40abfd10-cb75-42f7-a08d-b0ef032a35df_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/dc6660f0-875c-4fe8-becc-32ef9fe29749_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/26089d6e-ec0b-41a0-85ab-d873e2a7584c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/b0bfd98c-9df5-4b2a-927c-aa46691d5bd1_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/38b4cbfe-c4e5-4158-b789-72352a9a5efb_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/7bc0a75e-3436-4b6c-a3e9-4a1537897680_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/cdcc65c6-9647-4e07-af4b-4da74194aa5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/c8d6436d-822f-4390-91d8-ade87ccd6914_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/20- 18K, 02/21- 26K', 'remarks': 'VOSA STATES 46K, 59K, DAMAGED SPARE KEY IN', 'virtual': False, 'seller': 'TCB Group - Value', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d0471923-74fa-44fe-b531-63906c03feb4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:50 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117002721, 'registration': 'HT19ODX', 'account': 'AST003', 'make': 'RENAULT', 'model': 'KADJAR HATCHBACK', 'derivative': '1.3 TCE Iconic 5dr', 'mileage': 66282, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-03-28', 'fuel': 'Petrol', 'motExpiry': '2026-08-21', 'doors': 5, 'engineSize': 1330, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HT19ODX/2025-11-12/image/44964eec-e4aa-4b80-aa15-61f416130649_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/40abfd10-cb75-42f7-a08d-b0ef032a35df_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/dc6660f0-875c-4fe8-becc-32ef9fe29749_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/26089d6e-ec0b-41a0-85ab-d873e2a7584c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/b0bfd98c-9df5-4b2a-927c-aa46691d5bd1_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/38b4cbfe-c4e5-4158-b789-72352a9a5efb_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/7bc0a75e-3436-4b6c-a3e9-4a1537897680_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/cdcc65c6-9647-4e07-af4b-4da74194aa5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/c8d6436d-822f-4390-91d8-ade87ccd6914_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/20- 18K, 02/21- 26K', 'remarks': 'VOSA STATES 46K, 59K, DAMAGED SPARE KEY IN', 'virtual': False, 'seller': 'TCB Group - Value', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d0471923-74fa-44fe-b531-63906c03feb4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb4712bc-835e-5d1b-8a87-785ebf261f12 with identifier: 117002721
2025-12-01 19:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb4712bc-835e-5d1b-8a87-785ebf261f12 with scrape type 1
2025-12-01 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item eb4712bc-835e-5d1b-8a87-785ebf261f12
2025-12-01 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHT19ODX%252F2025-11-12%252Fimage%252F44964eec-e4aa-4b80-aa15-61f416130649_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT19ODX/2025-11-12/image/44964eec-e4aa-4b80-aa15-61f416130649_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:50 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117583554, 'registration': 'LX69ZCA', 'account': 'MER167', 'make': 'BMW', 'model': '4 SERIES COUPE', 'derivative': '420i M Sport 2dr Auto [Professional Media]', 'mileage': 36190, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-10-31', 'fuel': 'Petrol', 'motExpiry': '2026-10-30', 'doors': 2, 'engineSize': 1998, 'bodyType': 'Coupe', 'images': ['https://abimg002.imgix.net/e3534934-bd99-4ab8-a29b-1648025deade.jpg?w=600', 'https://abimg002.imgix.net/1ab4000c-3b01-470f-87b2-02bb7e3825af.jpg?w=600', 'https://abimg002.imgix.net/d4c1a4bf-a4c8-4e32-b772-a4a41eec71d7.jpg?w=600', 'https://abimg002.imgix.net/5ca83b90-4a41-40ad-8503-36d58d241517.jpg?w=600', 'https://abimg002.imgix.net/b0b3254f-3a2f-4541-8ae0-ac7773d398d9.jpg?w=600', 'https://abimg002.imgix.net/c40030d0-3598-463b-be8f-bc212d66e04a.jpg?w=600', 'https://abimg002.imgix.net/c31e1f37-399a-431a-a685-d86357edb54f.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': 'Service invoice 05/22-12K 10/23-21K', 'remarks': 'CHERISHED PLATE NOT INCLUDED, SPARE KEY IN OFFICE, VOSA STATES 14K 21K 29K 35K', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:50 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117583554, 'registration': 'LX69ZCA', 'account': 'MER167', 'make': 'BMW', 'model': '4 SERIES COUPE', 'derivative': '420i M Sport 2dr Auto [Professional Media]', 'mileage': 36190, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-10-31', 'fuel': 'Petrol', 'motExpiry': '2026-10-30', 'doors': 2, 'engineSize': 1998, 'bodyType': 'Coupe', 'images': ['https://abimg002.imgix.net/e3534934-bd99-4ab8-a29b-1648025deade.jpg?w=600', 'https://abimg002.imgix.net/1ab4000c-3b01-470f-87b2-02bb7e3825af.jpg?w=600', 'https://abimg002.imgix.net/d4c1a4bf-a4c8-4e32-b772-a4a41eec71d7.jpg?w=600', 'https://abimg002.imgix.net/5ca83b90-4a41-40ad-8503-36d58d241517.jpg?w=600', 'https://abimg002.imgix.net/b0b3254f-3a2f-4541-8ae0-ac7773d398d9.jpg?w=600', 'https://abimg002.imgix.net/c40030d0-3598-463b-be8f-bc212d66e04a.jpg?w=600', 'https://abimg002.imgix.net/c31e1f37-399a-431a-a685-d86357edb54f.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': 'Service invoice 05/22-12K 10/23-21K', 'remarks': 'CHERISHED PLATE NOT INCLUDED, SPARE KEY IN OFFICE, VOSA STATES 14K 21K 29K 35K', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6df76f5-230a-5312-9d25-ecfb29918ae6 with identifier: 117583554
2025-12-01 19:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6df76f5-230a-5312-9d25-ecfb29918ae6 with scrape type 1
2025-12-01 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item b6df76f5-230a-5312-9d25-ecfb29918ae6
2025-12-01 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fe3534934-bd99-4ab8-a29b-1648025deade.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/e3534934-bd99-4ab8-a29b-1648025deade.jpg?w=600 not downloaded yet
2025-12-01 19:00:50 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117563502, 'registration': 'WV68ZBX', 'account': 'STE009', 'make': 'MITSUBISHI', 'model': 'OUTLANDER DIESEL ESTATE', 'derivative': '2.2 DI-D 4 5dr Auto', 'mileage': 55097, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-09-28', 'fuel': 'Diesel', 'motExpiry': '2026-03-18', 'doors': 5, 'engineSize': 2268, 'bodyType': 'Estate', 'images': ['https://abimg002.imgix.net/d8ed44f8-6a5e-43ce-96a5-89e8d6d1f331.jpg?w=600', 'https://abimg002.imgix.net/f4fa26c8-b4ad-4f2c-af2d-df9b23841ada.jpg?w=600', 'https://abimg002.imgix.net/f5f6f6ac-35d9-4ff9-97b4-6b0d2c3fede0.jpg?w=600', 'https://abimg002.imgix.net/2c20bbba-5998-4c4d-be27-2046982c5dc9.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': 'Service book 09/19-4K 08/20-10K 05/21-15K 05/22-23K 02/23-30K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 23K 30K 37K 49K', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 154, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/09b42d16-f9d2-4382-940e-e84889194c27.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:50 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117563502, 'registration': 'WV68ZBX', 'account': 'STE009', 'make': 'MITSUBISHI', 'model': 'OUTLANDER DIESEL ESTATE', 'derivative': '2.2 DI-D 4 5dr Auto', 'mileage': 55097, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-09-28', 'fuel': 'Diesel', 'motExpiry': '2026-03-18', 'doors': 5, 'engineSize': 2268, 'bodyType': 'Estate', 'images': ['https://abimg002.imgix.net/d8ed44f8-6a5e-43ce-96a5-89e8d6d1f331.jpg?w=600', 'https://abimg002.imgix.net/f4fa26c8-b4ad-4f2c-af2d-df9b23841ada.jpg?w=600', 'https://abimg002.imgix.net/f5f6f6ac-35d9-4ff9-97b4-6b0d2c3fede0.jpg?w=600', 'https://abimg002.imgix.net/2c20bbba-5998-4c4d-be27-2046982c5dc9.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': 'Service book 09/19-4K 08/20-10K 05/21-15K 05/22-23K 02/23-30K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 23K 30K 37K 49K', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 154, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/09b42d16-f9d2-4382-940e-e84889194c27.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15f02e94-b6b8-5898-baab-8d66d2e3eb15 with identifier: 117563502
2025-12-01 19:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15f02e94-b6b8-5898-baab-8d66d2e3eb15 with scrape type 1
2025-12-01 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 15f02e94-b6b8-5898-baab-8d66d2e3eb15
2025-12-01 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fd8ed44f8-6a5e-43ce-96a5-89e8d6d1f331.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/d8ed44f8-6a5e-43ce-96a5-89e8d6d1f331.jpg?w=600 not downloaded yet
2025-12-01 19:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV71RCF/2025-12-01/image/0ca52801-ecac-4485-bab6-adbec70ab718_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549131?view=catalogue)
2025-12-01 19:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB66AVM/2025-12-01/image/059e3e4d-3359-4fb7-97b2-ec35a2823d89_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117583759?view=catalogue)
2025-12-01 19:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GC65DZW/2025-11-26/image/ec6e9e30-66ba-4173-a850-9625294d9298_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117495142?view=catalogue)
2025-12-01 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FET17TNV%252F2025-12-01%252Fimage%252F008c7464-e0c0-4f44-9054-7f8ee27989ab_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET17TNV/2025-12-01/image/008c7464-e0c0-4f44-9054-7f8ee27989ab_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGC65DZW%252F2025-11-26%252Fimage%252F37d9c286-8ba9-40f0-88a3-efe5214b23c7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GC65DZW/2025-11-26/image/37d9c286-8ba9-40f0-88a3-efe5214b23c7_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV71RCF%252F2025-12-01%252Fimage%252F809d4590-4293-4d42-b8ed-66bc39ba6e76_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV71RCF/2025-12-01/image/809d4590-4293-4d42-b8ed-66bc39ba6e76_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0e3e9c6c-f246-5405-ac96-76e6a1737954 with identifier: 117207188
2025-12-01 19:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0e3e9c6c-f246-5405-ac96-76e6a1737954 with identifier: 117207188
2025-12-01 19:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0e3e9c6c-f246-5405-ac96-76e6a1737954 with identifier: 117207188 to the API
2025-12-01 19:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117207188?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0e3e9c6c-f246-5405-ac96-76e6a1737954',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BU21HYC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117207188',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'JEEP',
 'model': 'RENEGADE HATCHBACK SPECIAL EDITION',
 'odometer': 21876,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-17',
 'seller_name': 'TCB Group - Prime',
 'title': 'JEEP RENEGADE HATCHBACK SPECIAL EDITION 1.0 T3 GSE Night Eagle II '
          '5dr',
 'transmission': 'manual',
 'trim': '1.0 T3 GSE Night Eagle II 5dr',
 'vin': None,
 'year': 2021}
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117207188%27 HTTP/1.1" 200 None
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Saving data for 117207188: {'auction_closing_time': 1764756000.0, 'created_time': 1763492568.692688, 'last_price_update_time': 1764615652.286174}
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117207188') HTTP/1.1" 204 0
2025-12-01 19:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 92454ddf-1dc2-588e-b630-dd71f18ddd7a with identifier: 117207172
2025-12-01 19:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 92454ddf-1dc2-588e-b630-dd71f18ddd7a with identifier: 117207172
2025-12-01 19:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 92454ddf-1dc2-588e-b630-dd71f18ddd7a with identifier: 117207172 to the API
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117207172?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '92454ddf-1dc2-588e-b630-dd71f18ddd7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LP68KPL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117207172',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'HONDA',
 'model': 'CR-V ESTATE',
 'odometer': 66046,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-21',
 'seller_name': 'TCB Group - Prime',
 'title': 'HONDA CR-V ESTATE 1.5 VTEC Turbo SR 5dr',
 'transmission': 'manual',
 'trim': '1.5 VTEC Turbo SR 5dr',
 'vin': None,
 'year': 2019}
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117207172%27 HTTP/1.1" 200 None
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Saving data for 117207172: {'auction_closing_time': 1764756000.0, 'created_time': 1763449278.224542, 'last_price_update_time': 1764615652.673232}
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117207172') HTTP/1.1" 204 0
2025-12-01 19:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV22BSX/2025-12-01/image/34efc721-5d09-4f98-8269-6cec7c402936_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117576078?view=catalogue)
2025-12-01 19:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ET17TNV/2025-12-01/image/5f65e192-02f6-46c1-86c7-b818124a8eca_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117596913?view=catalogue)
2025-12-01 19:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB66AVM/2025-12-01/image/ca952cdc-1ef5-4030-b8ee-8ad926443e33_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117583759?view=catalogue)
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 117364905
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117364905%27 HTTP/1.1" 200 None
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Scrape type for 117364905: 0
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 117517693
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517693%27 HTTP/1.1" 200 None
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Scrape type for 117517693: 0
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 117550564
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550564%27 HTTP/1.1" 200 None
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Scrape type for 117550564: 0
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 117550544
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550544%27 HTTP/1.1" 200 None
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Scrape type for 117550544: 0
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 117554856
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554856%27 HTTP/1.1" 200 None
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Scrape type for 117554856: 0
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 117554544
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554544%27 HTTP/1.1" 200 None
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Scrape type for 117554544: 0
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 117517620
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517620%27 HTTP/1.1" 200 None
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Scrape type for 117517620: 0
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 117554554
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554554%27 HTTP/1.1" 200 None
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Scrape type for 117554554: 0
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 117554643
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554643%27 HTTP/1.1" 200 None
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Scrape type for 117554643: 0
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 117554665
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554665%27 HTTP/1.1" 200 None
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Scrape type for 117554665: 0
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 117554866
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554866%27 HTTP/1.1" 200 None
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Scrape type for 117554866: 0
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 117517675
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517675%27 HTTP/1.1" 200 None
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Scrape type for 117517675: 0
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 117554653
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554653%27 HTTP/1.1" 200 None
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Scrape type for 117554653: 0
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 117554737
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554737%27 HTTP/1.1" 200 None
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Scrape type for 117554737: 0
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 117554620
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554620%27 HTTP/1.1" 200 None
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Scrape type for 117554620: 0
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 117554834
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554834%27 HTTP/1.1" 200 None
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Scrape type for 117554834: 0
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 117554783
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554783%27 HTTP/1.1" 200 None
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Scrape type for 117554783: 0
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 117554799
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554799%27 HTTP/1.1" 200 None
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Scrape type for 117554799: 0
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 117517662
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517662%27 HTTP/1.1" 200 None
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Scrape type for 117517662: 0
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 117554583
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554583%27 HTTP/1.1" 200 None
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Scrape type for 117554583: 0
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 117554753
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554753%27 HTTP/1.1" 200 None
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Scrape type for 117554753: 0
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 117492465
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117492465%27 HTTP/1.1" 200 None
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Scrape type for 117492465: 0
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 117407507
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407507%27 HTTP/1.1" 200 None
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Scrape type for 117407507: 0
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 117554820
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554820%27 HTTP/1.1" 200 None
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Scrape type for 117554820: 0
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 117214042
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117214042%27 HTTP/1.1" 200 None
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Scrape type for 117214042: 0
2025-12-01 19:00:52 [astonbarclay.gb] INFO: Found listing with ID: 117446295
2025-12-01 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117446295%27 HTTP/1.1" 200 None
2025-12-01 19:00:53 [astonbarclay.gb] INFO: Scrape type for 117446295: 0
2025-12-01 19:00:53 [astonbarclay.gb] INFO: Found listing with ID: 117446284
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117446284%27 HTTP/1.1" 200 None
2025-12-01 19:00:53 [astonbarclay.gb] INFO: Scrape type for 117446284: 0
2025-12-01 19:00:53 [astonbarclay.gb] INFO: Found listing with ID: 117506955
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117506955%27 HTTP/1.1" 200 None
2025-12-01 19:00:53 [astonbarclay.gb] INFO: Scrape type for 117506955: 0
2025-12-01 19:00:53 [astonbarclay.gb] INFO: Found listing with ID: 117584337
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584337%27 HTTP/1.1" 200 None
2025-12-01 19:00:53 [astonbarclay.gb] INFO: Scrape type for 117584337: 0
2025-12-01 19:00:53 [astonbarclay.gb] INFO: Found listing with ID: 117584298
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584298%27 HTTP/1.1" 200 None
2025-12-01 19:00:53 [astonbarclay.gb] INFO: Scrape type for 117584298: 0
2025-12-01 19:00:53 [astonbarclay.gb] INFO: Found listing with ID: 117584308
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584308%27 HTTP/1.1" 200 None
2025-12-01 19:00:53 [astonbarclay.gb] INFO: Scrape type for 117584308: 0
2025-12-01 19:00:53 [astonbarclay.gb] INFO: Found listing with ID: 117491238
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117491238%27 HTTP/1.1" 200 None
2025-12-01 19:00:53 [astonbarclay.gb] INFO: Scrape type for 117491238: 1
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB66AVM%252F2025-12-01%252Fimage%252Ff917434e-1f34-4d80-9d4e-dc94bd53757e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB66AVM/2025-12-01/image/f917434e-1f34-4d80-9d4e-dc94bd53757e_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV22BSX%252F2025-12-01%252Fimage%252Ff2f44ac0-22c4-4e06-a4b0-8b2318e1aa31_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV22BSX/2025-12-01/image/f2f44ac0-22c4-4e06-a4b0-8b2318e1aa31_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX20XCS%252F2025-12-01%252Fimage%252F2299d1ed-3acf-4119-92ce-6411aefa8183_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX20XCS/2025-12-01/image/2299d1ed-3acf-4119-92ce-6411aefa8183_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHT19ODX%252F2025-11-12%252Fimage%252F40abfd10-cb75-42f7-a08d-b0ef032a35df_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT19ODX/2025-11-12/image/40abfd10-cb75-42f7-a08d-b0ef032a35df_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F1ab4000c-3b01-470f-87b2-02bb7e3825af.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/1ab4000c-3b01-470f-87b2-02bb7e3825af.jpg?w=600 not downloaded yet
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Ff4fa26c8-b4ad-4f2c-af2d-df9b23841ada.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/f4fa26c8-b4ad-4f2c-af2d-df9b23841ada.jpg?w=600 not downloaded yet
2025-12-01 19:00:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e8f6e10>
2025-12-01 19:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41a9bad-985b-5457-94ae-8b214ecf4c78/a41a9bad-985b-5457-94ae-8b214ecf4c78_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGC65DZW%252F2025-11-26%252Fimage%252Fa07d8dde-542c-4e65-a443-d6de9c812000_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GC65DZW/2025-11-26/image/a07d8dde-542c-4e65-a443-d6de9c812000_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a41a9bad-985b-5457-94ae-8b214ecf4c78
2025-12-01 19:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV22BSX/2025-12-01/image/b8be238b-5f38-46a9-9091-99911abefaeb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117576078?view=catalogue)
2025-12-01 19:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB66AVM/2025-12-01/image/1ee2b024-5002-4147-a8a5-1a6d9addde23_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117583759?view=catalogue)
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FET17TNV%252F2025-12-01%252Fimage%252F8b12ae8d-d896-478d-aed8-d1600b6e77f3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET17TNV/2025-12-01/image/8b12ae8d-d896-478d-aed8-d1600b6e77f3_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGC65DZW%252F2025-11-26%252Fimage%252F747a7451-dce7-4096-adb0-d6ee56a3f03d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GC65DZW/2025-11-26/image/747a7451-dce7-4096-adb0-d6ee56a3f03d_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV71RCF%252F2025-12-01%252Fimage%252Fa84153f4-202b-4257-9620-1d034021001f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV71RCF/2025-12-01/image/a84153f4-202b-4257-9620-1d034021001f_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f25f2d0>
2025-12-01 19:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49ea86bd-0188-543f-9dff-87dbf2d122aa/49ea86bd-0188-543f-9dff-87dbf2d122aa_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV22BSX%252F2025-12-01%252Fimage%252F05eb512c-813b-4e5d-95f5-fd51626b4ac5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV22BSX/2025-12-01/image/05eb512c-813b-4e5d-95f5-fd51626b4ac5_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 49ea86bd-0188-543f-9dff-87dbf2d122aa
2025-12-01 19:00:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e535b10>
2025-12-01 19:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-01 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7553a85-b1d7-5800-8c41-acd80624ea68/c7553a85-b1d7-5800-8c41-acd80624ea68_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FET17TNV%252F2025-12-01%252Fimage%252Fa23519b1-141a-489d-8ae3-066427c44f25_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET17TNV/2025-12-01/image/a23519b1-141a-489d-8ae3-066427c44f25_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c7553a85-b1d7-5800-8c41-acd80624ea68
2025-12-01 19:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV22BSX/2025-12-01/image/da2007e4-588b-48db-8e4f-baba97535507_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117576078?view=catalogue)
2025-12-01 19:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV71RCF/2025-12-01/image/c61f9146-bf8a-4c1d-b2d7-5dfe9ad7657b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549131?view=catalogue)
2025-12-01 19:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB66AVM/2025-12-01/image/c233feda-fb26-4c8f-9198-1b3402a634ca_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117583759?view=catalogue)
2025-12-01 19:00:54 [astonbarclay.gb] INFO: Found listing with ID: 117033189
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117033189%27 HTTP/1.1" 200 None
2025-12-01 19:00:54 [astonbarclay.gb] INFO: Scrape type for 117033189: 0
2025-12-01 19:00:54 [astonbarclay.gb] INFO: Found listing with ID: 117121049
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117121049%27 HTTP/1.1" 200 None
2025-12-01 19:00:54 [astonbarclay.gb] INFO: Scrape type for 117121049: 0
2025-12-01 19:00:54 [astonbarclay.gb] INFO: Found listing with ID: 117517747
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517747%27 HTTP/1.1" 200 None
2025-12-01 19:00:54 [astonbarclay.gb] INFO: Scrape type for 117517747: 0
2025-12-01 19:00:54 [astonbarclay.gb] INFO: Found listing with ID: 117554606
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554606%27 HTTP/1.1" 200 None
2025-12-01 19:00:54 [astonbarclay.gb] INFO: Scrape type for 117554606: 0
2025-12-01 19:00:54 [astonbarclay.gb] INFO: Found listing with ID: 117571526
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117571526%27 HTTP/1.1" 200 None
2025-12-01 19:00:54 [astonbarclay.gb] INFO: Scrape type for 117571526: 1
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB66AVM%252F2025-12-01%252Fimage%252F09dd2531-a177-4090-b146-39b989553254_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB66AVM/2025-12-01/image/09dd2531-a177-4090-b146-39b989553254_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV22BSX%252F2025-12-01%252Fimage%252F121f1a1c-cae5-4087-8b77-142d917a6b27_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV22BSX/2025-12-01/image/121f1a1c-cae5-4087-8b77-142d917a6b27_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX20XCS%252F2025-12-01%252Fimage%252F91491da4-8199-44f4-90b0-2d80f5f5a373_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX20XCS/2025-12-01/image/91491da4-8199-44f4-90b0-2d80f5f5a373_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHT19ODX%252F2025-11-12%252Fimage%252Fdc6660f0-875c-4fe8-becc-32ef9fe29749_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT19ODX/2025-11-12/image/dc6660f0-875c-4fe8-becc-32ef9fe29749_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fd4c1a4bf-a4c8-4e32-b772-a4a41eec71d7.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/d4c1a4bf-a4c8-4e32-b772-a4a41eec71d7.jpg?w=600 not downloaded yet
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Ff5f6f6ac-35d9-4ff9-97b4-6b0d2c3fede0.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/f5f6f6ac-35d9-4ff9-97b4-6b0d2c3fede0.jpg?w=600 not downloaded yet
2025-12-01 19:00:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f2d77d0>
2025-12-01 19:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c28ca92-e6d5-5e58-b0d2-611709a3df7b/3c28ca92-e6d5-5e58-b0d2-611709a3df7b_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV71RCF%252F2025-12-01%252Fimage%252F0ca52801-ecac-4485-bab6-adbec70ab718_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV71RCF/2025-12-01/image/0ca52801-ecac-4485-bab6-adbec70ab718_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c28ca92-e6d5-5e58-b0d2-611709a3df7b
2025-12-01 19:00:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e565910>
2025-12-01 19:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91e3816c-1299-58c7-b5f9-71f70184e072/91e3816c-1299-58c7-b5f9-71f70184e072_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB66AVM%252F2025-12-01%252Fimage%252F059e3e4d-3359-4fb7-97b2-ec35a2823d89_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB66AVM/2025-12-01/image/059e3e4d-3359-4fb7-97b2-ec35a2823d89_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 91e3816c-1299-58c7-b5f9-71f70184e072
2025-12-01 19:00:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e564650>
2025-12-01 19:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41a9bad-985b-5457-94ae-8b214ecf4c78/a41a9bad-985b-5457-94ae-8b214ecf4c78_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGC65DZW%252F2025-11-26%252Fimage%252Fec6e9e30-66ba-4173-a850-9625294d9298_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GC65DZW/2025-11-26/image/ec6e9e30-66ba-4173-a850-9625294d9298_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a41a9bad-985b-5457-94ae-8b214ecf4c78
2025-12-01 19:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ET17TNV/2025-12-01/image/cdd6f396-36f2-47d7-875a-59e91c12d5ac_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117596913?view=catalogue)
2025-12-01 19:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV71RCF/2025-12-01/image/34508758-cdd5-42a8-9bf4-6131df3267eb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549131?view=catalogue)
2025-12-01 19:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GC65DZW/2025-11-26/image/7d8543f3-be50-4ffd-865d-e8a9f8cb2578_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117495142?view=catalogue)
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FET17TNV%252F2025-12-01%252Fimage%252F3049ae76-41a8-4209-834d-73f2b0dba9cc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET17TNV/2025-12-01/image/3049ae76-41a8-4209-834d-73f2b0dba9cc_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGC65DZW%252F2025-11-26%252Fimage%252F56c53d51-1db8-49f3-8d86-3c2f63d13992_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GC65DZW/2025-11-26/image/56c53d51-1db8-49f3-8d86-3c2f63d13992_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV71RCF%252F2025-12-01%252Fimage%252F0aa2e920-125f-4c72-9656-f0bd3074991e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV71RCF/2025-12-01/image/0aa2e920-125f-4c72-9656-f0bd3074991e_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e725890>
2025-12-01 19:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49ea86bd-0188-543f-9dff-87dbf2d122aa/49ea86bd-0188-543f-9dff-87dbf2d122aa_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV22BSX%252F2025-12-01%252Fimage%252F34efc721-5d09-4f98-8269-6cec7c402936_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV22BSX/2025-12-01/image/34efc721-5d09-4f98-8269-6cec7c402936_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 49ea86bd-0188-543f-9dff-87dbf2d122aa
2025-12-01 19:00:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e766f50>
2025-12-01 19:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7553a85-b1d7-5800-8c41-acd80624ea68/c7553a85-b1d7-5800-8c41-acd80624ea68_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FET17TNV%252F2025-12-01%252Fimage%252F5f65e192-02f6-46c1-86c7-b818124a8eca_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET17TNV/2025-12-01/image/5f65e192-02f6-46c1-86c7-b818124a8eca_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c7553a85-b1d7-5800-8c41-acd80624ea68
2025-12-01 19:00:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e7a8790>
2025-12-01 19:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91e3816c-1299-58c7-b5f9-71f70184e072/91e3816c-1299-58c7-b5f9-71f70184e072_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB66AVM%252F2025-12-01%252Fimage%252Fca952cdc-1ef5-4030-b8ee-8ad926443e33_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB66AVM/2025-12-01/image/ca952cdc-1ef5-4030-b8ee-8ad926443e33_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 91e3816c-1299-58c7-b5f9-71f70184e072
2025-12-01 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HT19ODX/2025-11-12/image/44964eec-e4aa-4b80-aa15-61f416130649_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117002721?view=catalogue)
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117546383
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117546383%27 HTTP/1.1" 200 None
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117546383: 0
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117605321
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117605321%27 HTTP/1.1" 200 None
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117605321: 0
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117600796
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600796%27 HTTP/1.1" 200 None
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117600796: 0
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117554715
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554715%27 HTTP/1.1" 200 None
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117554715: 0
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117403071
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117403071%27 HTTP/1.1" 200 None
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117403071: 0
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117584474
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584474%27 HTTP/1.1" 200 None
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117584474: 0
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117584452
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584452%27 HTTP/1.1" 200 None
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117584452: 0
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117584328
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584328%27 HTTP/1.1" 200 None
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117584328: 0
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117459261
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459261%27 HTTP/1.1" 200 None
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117459261: 0
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117120537
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117120537%27 HTTP/1.1" 200 None
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117120537: 0
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 116699739
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116699739%27 HTTP/1.1" 200 None
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Scrape type for 116699739: 0
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117400056
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117400056%27 HTTP/1.1" 200 None
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117400056: 0
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117215446
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117215446%27 HTTP/1.1" 200 None
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117215446: 0
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117215585
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117215585%27 HTTP/1.1" 200 None
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117215585: 0
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117442253
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117442253%27 HTTP/1.1" 200 None
2025-12-01 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117442253: 1
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB66AVM%252F2025-12-01%252Fimage%252F3bad41e8-555c-4d01-9e08-c58d2065170f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB66AVM/2025-12-01/image/3bad41e8-555c-4d01-9e08-c58d2065170f_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV22BSX%252F2025-12-01%252Fimage%252Ffa3fb67b-dfcb-4a6f-ab35-4bfc8a31420a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV22BSX/2025-12-01/image/fa3fb67b-dfcb-4a6f-ab35-4bfc8a31420a_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX20XCS%252F2025-12-01%252Fimage%252Fbe057c18-49cf-4429-9c61-e5ca012cc4be_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX20XCS/2025-12-01/image/be057c18-49cf-4429-9c61-e5ca012cc4be_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHT19ODX%252F2025-11-12%252Fimage%252F26089d6e-ec0b-41a0-85ab-d873e2a7584c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT19ODX/2025-11-12/image/26089d6e-ec0b-41a0-85ab-d873e2a7584c_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F5ca83b90-4a41-40ad-8503-36d58d241517.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/5ca83b90-4a41-40ad-8503-36d58d241517.jpg?w=600 not downloaded yet
2025-12-01 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F2c20bbba-5998-4c4d-be27-2046982c5dc9.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/2c20bbba-5998-4c4d-be27-2046982c5dc9.jpg?w=600 not downloaded yet
2025-12-01 19:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117592979?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117616319?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e537750>
2025-12-01 19:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49ea86bd-0188-543f-9dff-87dbf2d122aa/49ea86bd-0188-543f-9dff-87dbf2d122aa_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV22BSX%252F2025-12-01%252Fimage%252Fb8be238b-5f38-46a9-9091-99911abefaeb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV22BSX/2025-12-01/image/b8be238b-5f38-46a9-9091-99911abefaeb_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 49ea86bd-0188-543f-9dff-87dbf2d122aa
2025-12-01 19:00:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e54bf50>
2025-12-01 19:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91e3816c-1299-58c7-b5f9-71f70184e072/91e3816c-1299-58c7-b5f9-71f70184e072_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB66AVM%252F2025-12-01%252Fimage%252F1ee2b024-5002-4147-a8a5-1a6d9addde23_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB66AVM/2025-12-01/image/1ee2b024-5002-4147-a8a5-1a6d9addde23_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 91e3816c-1299-58c7-b5f9-71f70184e072
2025-12-01 19:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GC65DZW/2025-11-26/image/37d9c286-8ba9-40f0-88a3-efe5214b23c7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117495142?view=catalogue)
2025-12-01 19:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV71RCF/2025-12-01/image/809d4590-4293-4d42-b8ed-66bc39ba6e76_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549131?view=catalogue)
2025-12-01 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV71RCF%252F2025-12-01%252Fimage%252F1a733e35-3dcc-4a34-b15a-d1e7d2dc866b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV71RCF/2025-12-01/image/1a733e35-3dcc-4a34-b15a-d1e7d2dc866b_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f215950>
2025-12-01 19:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49ea86bd-0188-543f-9dff-87dbf2d122aa/49ea86bd-0188-543f-9dff-87dbf2d122aa_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV22BSX%252F2025-12-01%252Fimage%252Fda2007e4-588b-48db-8e4f-baba97535507_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV22BSX/2025-12-01/image/da2007e4-588b-48db-8e4f-baba97535507_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 49ea86bd-0188-543f-9dff-87dbf2d122aa
2025-12-01 19:00:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f2c7690>
2025-12-01 19:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c28ca92-e6d5-5e58-b0d2-611709a3df7b/3c28ca92-e6d5-5e58-b0d2-611709a3df7b_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV71RCF%252F2025-12-01%252Fimage%252Fc61f9146-bf8a-4c1d-b2d7-5dfe9ad7657b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV71RCF/2025-12-01/image/c61f9146-bf8a-4c1d-b2d7-5dfe9ad7657b_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c28ca92-e6d5-5e58-b0d2-611709a3df7b
2025-12-01 19:00:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f388450>
2025-12-01 19:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91e3816c-1299-58c7-b5f9-71f70184e072/91e3816c-1299-58c7-b5f9-71f70184e072_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB66AVM%252F2025-12-01%252Fimage%252Fc233feda-fb26-4c8f-9198-1b3402a634ca_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB66AVM/2025-12-01/image/c233feda-fb26-4c8f-9198-1b3402a634ca_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 91e3816c-1299-58c7-b5f9-71f70184e072
2025-12-01 19:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HT19ODX/2025-11-12/image/40abfd10-cb75-42f7-a08d-b0ef032a35df_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117002721?view=catalogue)
2025-12-01 19:00:57 [astonbarclay.gb] INFO: Found listing with ID: 117222053
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117222053%27 HTTP/1.1" 200 None
2025-12-01 19:00:57 [astonbarclay.gb] INFO: Scrape type for 117222053: 0
2025-12-01 19:00:57 [astonbarclay.gb] INFO: Found listing with ID: 117311401
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117311401%27 HTTP/1.1" 200 None
2025-12-01 19:00:57 [astonbarclay.gb] INFO: Scrape type for 117311401: 0
2025-12-01 19:00:57 [astonbarclay.gb] INFO: Found listing with ID: 117548617
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117548617%27 HTTP/1.1" 200 None
2025-12-01 19:00:57 [astonbarclay.gb] INFO: Scrape type for 117548617: 1
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB66AVM%252F2025-12-01%252Fimage%252Feb36ef3d-ad39-4952-9e2f-d2cd6c843415_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB66AVM/2025-12-01/image/eb36ef3d-ad39-4952-9e2f-d2cd6c843415_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV22BSX%252F2025-12-01%252Fimage%252F320ef761-bd02-47d6-b931-ef1f5cf97e6d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV22BSX/2025-12-01/image/320ef761-bd02-47d6-b931-ef1f5cf97e6d_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX20XCS%252F2025-12-01%252Fimage%252F0f10db47-9ddd-45ff-86da-1fee84a2b99b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX20XCS/2025-12-01/image/0f10db47-9ddd-45ff-86da-1fee84a2b99b_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHT19ODX%252F2025-11-12%252Fimage%252Fb0bfd98c-9df5-4b2a-927c-aa46691d5bd1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT19ODX/2025-11-12/image/b0bfd98c-9df5-4b2a-927c-aa46691d5bd1_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fb0b3254f-3a2f-4541-8ae0-ac7773d398d9.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/b0b3254f-3a2f-4541-8ae0-ac7773d398d9.jpg?w=600 not downloaded yet
2025-12-01 19:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117262074?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117566737?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e577750>
2025-12-01 19:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7553a85-b1d7-5800-8c41-acd80624ea68/c7553a85-b1d7-5800-8c41-acd80624ea68_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FET17TNV%252F2025-12-01%252Fimage%252Fcdd6f396-36f2-47d7-875a-59e91c12d5ac_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET17TNV/2025-12-01/image/cdd6f396-36f2-47d7-875a-59e91c12d5ac_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c7553a85-b1d7-5800-8c41-acd80624ea68
2025-12-01 19:00:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e57b450>
2025-12-01 19:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c28ca92-e6d5-5e58-b0d2-611709a3df7b/3c28ca92-e6d5-5e58-b0d2-611709a3df7b_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV71RCF%252F2025-12-01%252Fimage%252F34508758-cdd5-42a8-9bf4-6131df3267eb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV71RCF/2025-12-01/image/34508758-cdd5-42a8-9bf4-6131df3267eb_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c28ca92-e6d5-5e58-b0d2-611709a3df7b
2025-12-01 19:00:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f2f5cd0>
2025-12-01 19:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41a9bad-985b-5457-94ae-8b214ecf4c78/a41a9bad-985b-5457-94ae-8b214ecf4c78_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGC65DZW%252F2025-11-26%252Fimage%252F7d8543f3-be50-4ffd-865d-e8a9f8cb2578_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GC65DZW/2025-11-26/image/7d8543f3-be50-4ffd-865d-e8a9f8cb2578_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a41a9bad-985b-5457-94ae-8b214ecf4c78
2025-12-01 19:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ET17TNV/2025-12-01/image/8b12ae8d-d896-478d-aed8-d1600b6e77f3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117596913?view=catalogue)
2025-12-01 19:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GC65DZW/2025-11-26/image/747a7451-dce7-4096-adb0-d6ee56a3f03d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117495142?view=catalogue)
2025-12-01 19:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV71RCF/2025-12-01/image/a84153f4-202b-4257-9620-1d034021001f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549131?view=catalogue)
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV71RCF%252F2025-12-01%252Fimage%252F5a662e02-9baa-4209-b786-b4816d697f1f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV71RCF/2025-12-01/image/5a662e02-9baa-4209-b786-b4816d697f1f_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f386e50>
2025-12-01 19:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4712bc-835e-5d1b-8a87-785ebf261f12/eb4712bc-835e-5d1b-8a87-785ebf261f12_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHT19ODX%252F2025-11-12%252Fimage%252F44964eec-e4aa-4b80-aa15-61f416130649_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT19ODX/2025-11-12/image/44964eec-e4aa-4b80-aa15-61f416130649_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb4712bc-835e-5d1b-8a87-785ebf261f12
2025-12-01 19:00:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117592979, 'registration': 'AX19OCE', 'account': 'SMC010', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.1 Zetec 3dr', 'mileage': 35321, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-04-01', 'doors': 3, 'engineSize': 1084, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AX19OCE/2025-12-01/image/ab423de8-5422-4764-ab54-6b073aec3eed_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/9bd2475c-1a8f-45a0-bd60-332edfb22ec1_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/4d202cf2-7af0-4b1c-ac8d-9f63083181e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/2cac4f0d-61b6-4d61-ab6d-47af306347f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/b4ed5a7a-79a4-4ca3-9975-2aa43396a084_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/4e4023df-36dc-4957-8545-b41f12bda182_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/5f43a055-a446-4d28-a98c-f584e0627747_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/c04ed6f9-e91c-4cfe-a1df-132b93008d26_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/3c18cc03-d1e5-45fa-a525-1e2ebe93f2b7_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 03/22 16K - 03/24 27K - 03/25 33K', 'remarks': 'PHOTOCOPY OF CURRENT V5 ONLY - VOSA STATES, 16K, 22K, 27K, 33K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'SMC Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2be181ec-e906-48b1-b137-76e9847ca46d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117592979, 'registration': 'AX19OCE', 'account': 'SMC010', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.1 Zetec 3dr', 'mileage': 35321, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-04-01', 'doors': 3, 'engineSize': 1084, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AX19OCE/2025-12-01/image/ab423de8-5422-4764-ab54-6b073aec3eed_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/9bd2475c-1a8f-45a0-bd60-332edfb22ec1_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/4d202cf2-7af0-4b1c-ac8d-9f63083181e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/2cac4f0d-61b6-4d61-ab6d-47af306347f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/b4ed5a7a-79a4-4ca3-9975-2aa43396a084_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/4e4023df-36dc-4957-8545-b41f12bda182_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/5f43a055-a446-4d28-a98c-f584e0627747_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/c04ed6f9-e91c-4cfe-a1df-132b93008d26_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/3c18cc03-d1e5-45fa-a525-1e2ebe93f2b7_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 03/22 16K - 03/24 27K - 03/25 33K', 'remarks': 'PHOTOCOPY OF CURRENT V5 ONLY - VOSA STATES, 16K, 22K, 27K, 33K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'SMC Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2be181ec-e906-48b1-b137-76e9847ca46d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab7e8163-878a-5bd5-bf93-2903eae01623 with identifier: 117592979
2025-12-01 19:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab7e8163-878a-5bd5-bf93-2903eae01623 with scrape type 1
2025-12-01 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item ab7e8163-878a-5bd5-bf93-2903eae01623
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAX19OCE%252F2025-12-01%252Fimage%252Fab423de8-5422-4764-ab54-6b073aec3eed_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19OCE/2025-12-01/image/ab423de8-5422-4764-ab54-6b073aec3eed_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117616319, 'registration': 'RA18NAU', 'account': 'WBA002', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '1.5 EcoBoost ST-Line 5dr 2WD', 'mileage': 76955, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-07-20', 'fuel': 'Petrol', 'motExpiry': '2026-10-14', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RA18NAU/2025-12-01/image/cd3d292a-7e9a-450b-a3d1-c410331ea832_removebg.jpg?w=600', 'https://abimg003.imgix.net/RA18NAU/2025-12-01/image/9cbfa473-d91a-485a-84b2-411e5b067827_removebg.jpg?w=600', 'https://abimg003.imgix.net/RA18NAU/2025-12-01/image/8ee310ba-26b5-4480-8f9b-d2e9bcd5ffcb_removebg.jpg?w=600', 'https://abimg003.imgix.net/RA18NAU/2025-12-01/image/07965700-b2b4-4363-b818-925b32a4f813_removebg.jpg?w=600', 'https://abimg003.imgix.net/RA18NAU/2025-12-01/image/ce665d6f-29db-4313-937c-8238eace441b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RA18NAU/2025-12-01/image/d26149cc-34e1-46bc-95e8-e0896c22025b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RA18NAU/2025-12-01/image/43ff0210-53c2-4142-bff3-7ff29517713b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RA18NAU/2025-12-01/image/9cfb9f61-3f90-4006-b345-35f4299f102c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RA18NAU/2025-12-01/image/53289123-b2a4-4ef5-8530-a1f945875b1e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RA18NAU/2025-12-01/image/085d6eeb-6001-4f87-afe8-1e087ecb3481_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 08/19- 14K, 07/20- 23K, 09/20- 26K', 'remarks': 'VOSA STATES 43K, 53K, 64K, 75K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 176, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bfe42c56-5363-4616-93e3-92d281fe7848.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117616319, 'registration': 'RA18NAU', 'account': 'WBA002', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '1.5 EcoBoost ST-Line 5dr 2WD', 'mileage': 76955, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-07-20', 'fuel': 'Petrol', 'motExpiry': '2026-10-14', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RA18NAU/2025-12-01/image/cd3d292a-7e9a-450b-a3d1-c410331ea832_removebg.jpg?w=600', 'https://abimg003.imgix.net/RA18NAU/2025-12-01/image/9cbfa473-d91a-485a-84b2-411e5b067827_removebg.jpg?w=600', 'https://abimg003.imgix.net/RA18NAU/2025-12-01/image/8ee310ba-26b5-4480-8f9b-d2e9bcd5ffcb_removebg.jpg?w=600', 'https://abimg003.imgix.net/RA18NAU/2025-12-01/image/07965700-b2b4-4363-b818-925b32a4f813_removebg.jpg?w=600', 'https://abimg003.imgix.net/RA18NAU/2025-12-01/image/ce665d6f-29db-4313-937c-8238eace441b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RA18NAU/2025-12-01/image/d26149cc-34e1-46bc-95e8-e0896c22025b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RA18NAU/2025-12-01/image/43ff0210-53c2-4142-bff3-7ff29517713b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RA18NAU/2025-12-01/image/9cfb9f61-3f90-4006-b345-35f4299f102c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RA18NAU/2025-12-01/image/53289123-b2a4-4ef5-8530-a1f945875b1e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RA18NAU/2025-12-01/image/085d6eeb-6001-4f87-afe8-1e087ecb3481_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 08/19- 14K, 07/20- 23K, 09/20- 26K', 'remarks': 'VOSA STATES 43K, 53K, 64K, 75K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 176, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bfe42c56-5363-4616-93e3-92d281fe7848.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1e54fb1-db98-567f-aff3-be7b913fc33c with identifier: 117616319
2025-12-01 19:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1e54fb1-db98-567f-aff3-be7b913fc33c with scrape type 1
2025-12-01 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a1e54fb1-db98-567f-aff3-be7b913fc33c
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRA18NAU%252F2025-12-01%252Fimage%252Fcd3d292a-7e9a-450b-a3d1-c410331ea832_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RA18NAU/2025-12-01/image/cd3d292a-7e9a-450b-a3d1-c410331ea832_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:58 [astonbarclay.gb] INFO: Found listing with ID: 117427071
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117427071%27 HTTP/1.1" 200 None
2025-12-01 19:00:58 [astonbarclay.gb] INFO: Scrape type for 117427071: 0
2025-12-01 19:00:58 [astonbarclay.gb] INFO: Found listing with ID: 117547841
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547841%27 HTTP/1.1" 200 None
2025-12-01 19:00:58 [astonbarclay.gb] INFO: Scrape type for 117547841: 1
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX20XCS%252F2025-12-01%252Fimage%252F05bb4e19-6169-4e76-a250-55b6df2a9397_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX20XCS/2025-12-01/image/05bb4e19-6169-4e76-a250-55b6df2a9397_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHT19ODX%252F2025-11-12%252Fimage%252F38b4cbfe-c4e5-4158-b789-72352a9a5efb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT19ODX/2025-11-12/image/38b4cbfe-c4e5-4158-b789-72352a9a5efb_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fc40030d0-3598-463b-be8f-bc212d66e04a.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/c40030d0-3598-463b-be8f-bc212d66e04a.jpg?w=600 not downloaded yet
2025-12-01 19:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117548417?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:00:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e78e890>
2025-12-01 19:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41a9bad-985b-5457-94ae-8b214ecf4c78/a41a9bad-985b-5457-94ae-8b214ecf4c78_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGC65DZW%252F2025-11-26%252Fimage%252F37d9c286-8ba9-40f0-88a3-efe5214b23c7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GC65DZW/2025-11-26/image/37d9c286-8ba9-40f0-88a3-efe5214b23c7_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a41a9bad-985b-5457-94ae-8b214ecf4c78
2025-12-01 19:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e821fd0>
2025-12-01 19:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c28ca92-e6d5-5e58-b0d2-611709a3df7b/3c28ca92-e6d5-5e58-b0d2-611709a3df7b_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV71RCF%252F2025-12-01%252Fimage%252F809d4590-4293-4d42-b8ed-66bc39ba6e76_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV71RCF/2025-12-01/image/809d4590-4293-4d42-b8ed-66bc39ba6e76_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c28ca92-e6d5-5e58-b0d2-611709a3df7b
2025-12-01 19:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GC65DZW/2025-11-26/image/56c53d51-1db8-49f3-8d86-3c2f63d13992_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117495142?view=catalogue)
2025-12-01 19:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ET17TNV/2025-12-01/image/3049ae76-41a8-4209-834d-73f2b0dba9cc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117596913?view=catalogue)
2025-12-01 19:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV71RCF/2025-12-01/image/0aa2e920-125f-4c72-9656-f0bd3074991e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549131?view=catalogue)
2025-12-01 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV71RCF%252F2025-12-01%252Fimage%252Fcf1d424d-c51c-4533-bfd8-29af3f745ec4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV71RCF/2025-12-01/image/cf1d424d-c51c-4533-bfd8-29af3f745ec4_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAX19OCE%252F2025-12-01%252Fimage%252F9bd2475c-1a8f-45a0-bd60-332edfb22ec1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19OCE/2025-12-01/image/9bd2475c-1a8f-45a0-bd60-332edfb22ec1_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRA18NAU%252F2025-12-01%252Fimage%252F9cbfa473-d91a-485a-84b2-411e5b067827_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RA18NAU/2025-12-01/image/9cbfa473-d91a-485a-84b2-411e5b067827_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f3a65d0>
2025-12-01 19:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4712bc-835e-5d1b-8a87-785ebf261f12/eb4712bc-835e-5d1b-8a87-785ebf261f12_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHT19ODX%252F2025-11-12%252Fimage%252F40abfd10-cb75-42f7-a08d-b0ef032a35df_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT19ODX/2025-11-12/image/40abfd10-cb75-42f7-a08d-b0ef032a35df_removebg.jpg?w=600 saved to cache
2025-12-01 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb4712bc-835e-5d1b-8a87-785ebf261f12
2025-12-01 19:00:59 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117262074, 'registration': 'EA69YXR', 'account': 'GAT001', 'make': 'TOYOTA', 'model': 'RAV4 ESTATE', 'derivative': '2.5 VVT-i Hybrid Excel 5dr CVT', 'mileage': 66565, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 581}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-01-29', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-06-24', 'doors': 5, 'engineSize': 2487, 'bodyType': 'Estate', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:59 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117262074, 'registration': 'EA69YXR', 'account': 'GAT001', 'make': 'TOYOTA', 'model': 'RAV4 ESTATE', 'derivative': '2.5 VVT-i Hybrid Excel 5dr CVT', 'mileage': 66565, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 581}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-01-29', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-06-24', 'doors': 5, 'engineSize': 2487, 'bodyType': 'Estate', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ffae733-3b62-5c90-a4e8-51b4ec2c5f5a with identifier: 117262074
2025-12-01 19:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ffae733-3b62-5c90-a4e8-51b4ec2c5f5a with scrape type 1
2025-12-01 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 3ffae733-3b62-5c90-a4e8-51b4ec2c5f5a
2025-12-01 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 3ffae733-3b62-5c90-a4e8-51b4ec2c5f5a
2025-12-01 19:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3ffae733-3b62-5c90-a4e8-51b4ec2c5f5a, identifier: 117262074
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117566737, 'registration': 'LY18UES', 'account': 'STE011', 'make': 'BMW', 'model': '5 SERIES DIESEL SALOON', 'derivative': '520d M Sport 4dr Auto', 'mileage': 58457, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 581}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-07-31', 'fuel': 'Diesel', 'motExpiry': '2026-07-30', 'doors': 4, 'engineSize': 1995, 'bodyType': 'Saloon', 'images': ['https://abimg002.imgix.net/2f85869f-2884-4399-90ff-ab98d096188d.jpg?w=600', 'https://abimg002.imgix.net/49c3d84c-f620-4baa-a00a-4f03d0dace26.jpg?w=600', 'https://abimg002.imgix.net/e7989f49-9b1e-49d7-941f-e6f5f99514e7.jpg?w=600', 'https://abimg002.imgix.net/0d7e25d6-9d86-4895-bd20-b20f3c612211.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/af93ea38-a74f-4b29-a5ae-805d45ffdd7d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117566737, 'registration': 'LY18UES', 'account': 'STE011', 'make': 'BMW', 'model': '5 SERIES DIESEL SALOON', 'derivative': '520d M Sport 4dr Auto', 'mileage': 58457, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 581}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-07-31', 'fuel': 'Diesel', 'motExpiry': '2026-07-30', 'doors': 4, 'engineSize': 1995, 'bodyType': 'Saloon', 'images': ['https://abimg002.imgix.net/2f85869f-2884-4399-90ff-ab98d096188d.jpg?w=600', 'https://abimg002.imgix.net/49c3d84c-f620-4baa-a00a-4f03d0dace26.jpg?w=600', 'https://abimg002.imgix.net/e7989f49-9b1e-49d7-941f-e6f5f99514e7.jpg?w=600', 'https://abimg002.imgix.net/0d7e25d6-9d86-4895-bd20-b20f3c612211.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/af93ea38-a74f-4b29-a5ae-805d45ffdd7d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fa6f041-4a63-54f8-a2e4-1ead2b370bf2 with identifier: 117566737
2025-12-01 19:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fa6f041-4a63-54f8-a2e4-1ead2b370bf2 with scrape type 1
2025-12-01 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 0fa6f041-4a63-54f8-a2e4-1ead2b370bf2
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F2f85869f-2884-4399-90ff-ab98d096188d.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/2f85869f-2884-4399-90ff-ab98d096188d.jpg?w=600 not downloaded yet
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117491214
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117491214%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117491214: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 116832725
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116832725%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 116832725: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 116339169
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116339169%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 116339169: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 116884737
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116884737%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 116884737: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117179358
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117179358%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117179358: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117209835
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117209835%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117209835: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117457018
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117457018%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117457018: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117103708
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117103708%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117103708: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117274456
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117274456%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117274456: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117274004
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117274004%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117274004: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117374089
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117374089%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117374089: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 116983938
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116983938%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 116983938: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117183441
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117183441%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117183441: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117243520
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117243520%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117243520: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 116699888
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116699888%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 116699888: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117019833
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117019833%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117019833: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117042418
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117042418%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117042418: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 116318543
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116318543%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 116318543: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 116879417
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116879417%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 116879417: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 116831775
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116831775%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 116831775: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117188811
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117188811%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117188811: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117341166
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117341166%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117341166: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117219826
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117219826%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117219826: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117180057
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117180057%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117180057: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117394554
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117394554%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117394554: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117458919
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117458919%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117458919: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117240084
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117240084%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117240084: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117288452
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117288452%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117288452: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117339782
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117339782%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117339782: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117180212
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117180212%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117180212: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117411712
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117411712%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117411712: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 116827121
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116827121%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 116827121: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117101159
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117101159%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117101159: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117539707
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117539707%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117539707: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 116914684
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116914684%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 116914684: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 116163300
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116163300%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 116163300: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 115951329
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115951329%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 115951329: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 115951209
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115951209%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 115951209: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 115951190
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115951190%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 115951190: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 115951284
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115951284%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 115951284: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117601450
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117601450%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117601450: 0
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117622575
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117622575%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117622575: 1
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX20XCS%252F2025-12-01%252Fimage%252F49947d55-ecbb-492d-ac6d-d04877c6132d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX20XCS/2025-12-01/image/49947d55-ecbb-492d-ac6d-d04877c6132d_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHT19ODX%252F2025-11-12%252Fimage%252F7bc0a75e-3436-4b6c-a3e9-4a1537897680_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT19ODX/2025-11-12/image/7bc0a75e-3436-4b6c-a3e9-4a1537897680_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fc31e1f37-399a-431a-a685-d86357edb54f.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/c31e1f37-399a-431a-a685-d86357edb54f.jpg?w=600 not downloaded yet
2025-12-01 19:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3ffae733-3b62-5c90-a4e8-51b4ec2c5f5a with identifier: 117262074
2025-12-01 19:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3ffae733-3b62-5c90-a4e8-51b4ec2c5f5a with identifier: 117262074
2025-12-01 19:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3ffae733-3b62-5c90-a4e8-51b4ec2c5f5a with identifier: 117262074 to the API
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%273ffae733-3b62-5c90-a4e8-51b4ec2c5f5a%27 HTTP/1.1" 200 None
2025-12-01 19:01:01 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 3ffae733-3b62-5c90-a4e8-51b4ec2c5f5a: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:01:00 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117262074?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '3ffae733-3b62-5c90-a4e8-51b4ec2c5f5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EA69YXR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117262074',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'TOYOTA',
 'model': 'RAV4 ESTATE',
 'odometer': 66565,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-29',
 'seller_name': 'Gates Group',
 'title': 'TOYOTA RAV4 ESTATE 2.5 VVT-i Hybrid Excel 5dr CVT',
 'transmission': 'automatic',
 'trim': '2.5 VVT-i Hybrid Excel 5dr CVT',
 'vin': None,
 'year': 2020}
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117262074%27 HTTP/1.1" 200 None
2025-12-01 19:01:01 [astonbarclay.gb] INFO: Saving data for 117262074: {'created_time': 1764615661.058488, 'last_price_update_time': 1764615661.058499, 'auction_closing_time': 1764756000.0}
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117262074') HTTP/1.1" 204 0
2025-12-01 19:01:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6bc410>
2025-12-01 19:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7553a85-b1d7-5800-8c41-acd80624ea68/c7553a85-b1d7-5800-8c41-acd80624ea68_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FET17TNV%252F2025-12-01%252Fimage%252F8b12ae8d-d896-478d-aed8-d1600b6e77f3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET17TNV/2025-12-01/image/8b12ae8d-d896-478d-aed8-d1600b6e77f3_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c7553a85-b1d7-5800-8c41-acd80624ea68
2025-12-01 19:01:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e704ad0>
2025-12-01 19:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41a9bad-985b-5457-94ae-8b214ecf4c78/a41a9bad-985b-5457-94ae-8b214ecf4c78_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGC65DZW%252F2025-11-26%252Fimage%252F747a7451-dce7-4096-adb0-d6ee56a3f03d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GC65DZW/2025-11-26/image/747a7451-dce7-4096-adb0-d6ee56a3f03d_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a41a9bad-985b-5457-94ae-8b214ecf4c78
2025-12-01 19:01:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e876550>
2025-12-01 19:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c28ca92-e6d5-5e58-b0d2-611709a3df7b/3c28ca92-e6d5-5e58-b0d2-611709a3df7b_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV71RCF%252F2025-12-01%252Fimage%252Fa84153f4-202b-4257-9620-1d034021001f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV71RCF/2025-12-01/image/a84153f4-202b-4257-9620-1d034021001f_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c28ca92-e6d5-5e58-b0d2-611709a3df7b
2025-12-01 19:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV22BSX/2025-12-01/image/fa3fb67b-dfcb-4a6f-ab35-4bfc8a31420a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117576078?view=catalogue)
2025-12-01 19:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV71RCF/2025-12-01/image/1a733e35-3dcc-4a34-b15a-d1e7d2dc866b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549131?view=catalogue)
2025-12-01 19:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HT19ODX/2025-11-12/image/26089d6e-ec0b-41a0-85ab-d873e2a7584c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117002721?view=catalogue)
2025-12-01 19:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX20XCS/2025-12-01/image/be057c18-49cf-4429-9c61-e5ca012cc4be_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549150?view=catalogue)
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV71RCF%252F2025-12-01%252Fimage%252F30d580c3-ef46-410b-bb0f-8511444dffb4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV71RCF/2025-12-01/image/30d580c3-ef46-410b-bb0f-8511444dffb4_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAX19OCE%252F2025-12-01%252Fimage%252F4d202cf2-7af0-4b1c-ac8d-9f63083181e2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19OCE/2025-12-01/image/4d202cf2-7af0-4b1c-ac8d-9f63083181e2_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRA18NAU%252F2025-12-01%252Fimage%252F8ee310ba-26b5-4480-8f9b-d2e9bcd5ffcb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RA18NAU/2025-12-01/image/8ee310ba-26b5-4480-8f9b-d2e9bcd5ffcb_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F49c3d84c-f620-4baa-a00a-4f03d0dace26.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/49c3d84c-f620-4baa-a00a-4f03d0dace26.jpg?w=600 not downloaded yet
2025-12-01 19:01:01 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117548417, 'registration': 'BV66OOB', 'account': 'STE093', 'make': 'AUDI', 'model': 'Q7 DIESEL ESTATE', 'derivative': '3.0 TDI Quattro S Line 5dr Tip Auto', 'mileage': 85130, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-09-01', 'fuel': 'Diesel', 'motExpiry': '2026-09-28', 'doors': 5, 'engineSize': 2967, 'bodyType': 'Estate', 'images': ['https://abimg002.imgix.net/d1822131-1401-4990-b1a1-1e858ca841bc.jpg?w=600', 'https://abimg002.imgix.net/0cc242f7-9ab8-4fa1-94bd-2ff0d7259aa8.jpg?w=600', 'https://abimg002.imgix.net/bbe79802-4288-4f39-a155-fe0903347232.jpg?w=600', 'https://abimg002.imgix.net/a59cfbe9-8ba6-4daf-997d-267dc8922808.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 163, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/463ce19a-b432-4389-b91b-ca8f76eae579.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:01 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117548417, 'registration': 'BV66OOB', 'account': 'STE093', 'make': 'AUDI', 'model': 'Q7 DIESEL ESTATE', 'derivative': '3.0 TDI Quattro S Line 5dr Tip Auto', 'mileage': 85130, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 584}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-09-01', 'fuel': 'Diesel', 'motExpiry': '2026-09-28', 'doors': 5, 'engineSize': 2967, 'bodyType': 'Estate', 'images': ['https://abimg002.imgix.net/d1822131-1401-4990-b1a1-1e858ca841bc.jpg?w=600', 'https://abimg002.imgix.net/0cc242f7-9ab8-4fa1-94bd-2ff0d7259aa8.jpg?w=600', 'https://abimg002.imgix.net/bbe79802-4288-4f39-a155-fe0903347232.jpg?w=600', 'https://abimg002.imgix.net/a59cfbe9-8ba6-4daf-997d-267dc8922808.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 163, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/463ce19a-b432-4389-b91b-ca8f76eae579.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ea4de05-9f41-53bd-8eb6-ee24111cb1a7 with identifier: 117548417
2025-12-01 19:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ea4de05-9f41-53bd-8eb6-ee24111cb1a7 with scrape type 1
2025-12-01 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 8ea4de05-9f41-53bd-8eb6-ee24111cb1a7
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fd1822131-1401-4990-b1a1-1e858ca841bc.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/d1822131-1401-4990-b1a1-1e858ca841bc.jpg?w=600 not downloaded yet
2025-12-01 19:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/d8ed44f8-6a5e-43ce-96a5-89e8d6d1f331.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117563502?view=catalogue)
2025-12-01 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117061252
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117061252%27 HTTP/1.1" 200 None
2025-12-01 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117061252: 0
2025-12-01 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117272138
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117272138%27 HTTP/1.1" 200 None
2025-12-01 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117272138: 0
2025-12-01 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117407202
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407202%27 HTTP/1.1" 200 None
2025-12-01 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117407202: 0
2025-12-01 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117418330
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117418330%27 HTTP/1.1" 200 None
2025-12-01 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117418330: 0
2025-12-01 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117427857
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117427857%27 HTTP/1.1" 200 None
2025-12-01 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117427857: 0
2025-12-01 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117489691
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117489691%27 HTTP/1.1" 200 None
2025-12-01 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117489691: 0
2025-12-01 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117420392
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117420392%27 HTTP/1.1" 200 None
2025-12-01 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117420392: 0
2025-12-01 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117580238
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117580238%27 HTTP/1.1" 200 None
2025-12-01 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117580238: 0
2025-12-01 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117573137
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573137%27 HTTP/1.1" 200 None
2025-12-01 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117573137: 0
2025-12-01 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117548415
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117548415%27 HTTP/1.1" 200 None
2025-12-01 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117548415: 1
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX20XCS%252F2025-12-01%252Fimage%252F9718708b-b93c-4ca1-8b3a-8e1ab8f38740_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX20XCS/2025-12-01/image/9718708b-b93c-4ca1-8b3a-8e1ab8f38740_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHT19ODX%252F2025-11-12%252Fimage%252Fcdcc65c6-9647-4e07-af4b-4da74194aa5c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT19ODX/2025-11-12/image/cdcc65c6-9647-4e07-af4b-4da74194aa5c_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e861890>
2025-12-01 19:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41a9bad-985b-5457-94ae-8b214ecf4c78/a41a9bad-985b-5457-94ae-8b214ecf4c78_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGC65DZW%252F2025-11-26%252Fimage%252F56c53d51-1db8-49f3-8d86-3c2f63d13992_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GC65DZW/2025-11-26/image/56c53d51-1db8-49f3-8d86-3c2f63d13992_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a41a9bad-985b-5457-94ae-8b214ecf4c78
2025-12-01 19:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e862150>
2025-12-01 19:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7553a85-b1d7-5800-8c41-acd80624ea68/c7553a85-b1d7-5800-8c41-acd80624ea68_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FET17TNV%252F2025-12-01%252Fimage%252F3049ae76-41a8-4209-834d-73f2b0dba9cc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET17TNV/2025-12-01/image/3049ae76-41a8-4209-834d-73f2b0dba9cc_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c7553a85-b1d7-5800-8c41-acd80624ea68
2025-12-01 19:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6a0dd0>
2025-12-01 19:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c28ca92-e6d5-5e58-b0d2-611709a3df7b/3c28ca92-e6d5-5e58-b0d2-611709a3df7b_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV71RCF%252F2025-12-01%252Fimage%252F0aa2e920-125f-4c72-9656-f0bd3074991e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV71RCF/2025-12-01/image/0aa2e920-125f-4c72-9656-f0bd3074991e_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c28ca92-e6d5-5e58-b0d2-611709a3df7b
2025-12-01 19:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AX19OCE/2025-12-01/image/ab423de8-5422-4764-ab54-6b073aec3eed_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117592979?view=catalogue)
2025-12-01 19:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RA18NAU/2025-12-01/image/cd3d292a-7e9a-450b-a3d1-c410331ea832_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616319?view=catalogue)
2025-12-01 19:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/e3534934-bd99-4ab8-a29b-1648025deade.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117583554?view=catalogue)
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAX19OCE%252F2025-12-01%252Fimage%252F2cac4f0d-61b6-4d61-ab6d-47af306347f5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19OCE/2025-12-01/image/2cac4f0d-61b6-4d61-ab6d-47af306347f5_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRA18NAU%252F2025-12-01%252Fimage%252F07965700-b2b4-4363-b818-925b32a4f813_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RA18NAU/2025-12-01/image/07965700-b2b4-4363-b818-925b32a4f813_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fe7989f49-9b1e-49d7-941f-e6f5f99514e7.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/e7989f49-9b1e-49d7-941f-e6f5f99514e7.jpg?w=600 not downloaded yet
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F0cc242f7-9ab8-4fa1-94bd-2ff0d7259aa8.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/0cc242f7-9ab8-4fa1-94bd-2ff0d7259aa8.jpg?w=600 not downloaded yet
2025-12-01 19:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/f4fa26c8-b4ad-4f2c-af2d-df9b23841ada.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117563502?view=catalogue)
2025-12-01 19:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV71RCF/2025-12-01/image/5a662e02-9baa-4209-b786-b4816d697f1f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549131?view=catalogue)
2025-12-01 19:01:03 [astonbarclay.gb] INFO: Found listing with ID: 115422003
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115422003%27 HTTP/1.1" 200 None
2025-12-01 19:01:03 [astonbarclay.gb] INFO: Scrape type for 115422003: 1
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX20XCS%252F2025-12-01%252Fimage%252Fc19aab74-26a0-4bff-bff0-d40950415a78_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX20XCS/2025-12-01/image/c19aab74-26a0-4bff-bff0-d40950415a78_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHT19ODX%252F2025-11-12%252Fimage%252Fc8d6436d-822f-4390-91d8-ade87ccd6914_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT19ODX/2025-11-12/image/c8d6436d-822f-4390-91d8-ade87ccd6914_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/1ab4000c-3b01-470f-87b2-02bb7e3825af.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117583554?view=catalogue)
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAX19OCE%252F2025-12-01%252Fimage%252Fb4ed5a7a-79a4-4ca3-9975-2aa43396a084_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19OCE/2025-12-01/image/b4ed5a7a-79a4-4ca3-9975-2aa43396a084_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRA18NAU%252F2025-12-01%252Fimage%252Fce665d6f-29db-4313-937c-8238eace441b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RA18NAU/2025-12-01/image/ce665d6f-29db-4313-937c-8238eace441b_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F0d7e25d6-9d86-4895-bd20-b20f3c612211.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/0d7e25d6-9d86-4895-bd20-b20f3c612211.jpg?w=600 not downloaded yet
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fbbe79802-4288-4f39-a155-fe0903347232.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/bbe79802-4288-4f39-a155-fe0903347232.jpg?w=600 not downloaded yet
2025-12-01 19:01:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f3d43d0>
2025-12-01 19:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49ea86bd-0188-543f-9dff-87dbf2d122aa/49ea86bd-0188-543f-9dff-87dbf2d122aa_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV22BSX%252F2025-12-01%252Fimage%252Ffa3fb67b-dfcb-4a6f-ab35-4bfc8a31420a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV22BSX/2025-12-01/image/fa3fb67b-dfcb-4a6f-ab35-4bfc8a31420a_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 49ea86bd-0188-543f-9dff-87dbf2d122aa
2025-12-01 19:01:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e7e7b50>
2025-12-01 19:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c28ca92-e6d5-5e58-b0d2-611709a3df7b/3c28ca92-e6d5-5e58-b0d2-611709a3df7b_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV71RCF%252F2025-12-01%252Fimage%252F1a733e35-3dcc-4a34-b15a-d1e7d2dc866b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV71RCF/2025-12-01/image/1a733e35-3dcc-4a34-b15a-d1e7d2dc866b_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c28ca92-e6d5-5e58-b0d2-611709a3df7b
2025-12-01 19:01:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6c5dd0>
2025-12-01 19:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4712bc-835e-5d1b-8a87-785ebf261f12/eb4712bc-835e-5d1b-8a87-785ebf261f12_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHT19ODX%252F2025-11-12%252Fimage%252F26089d6e-ec0b-41a0-85ab-d873e2a7584c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT19ODX/2025-11-12/image/26089d6e-ec0b-41a0-85ab-d873e2a7584c_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb4712bc-835e-5d1b-8a87-785ebf261f12
2025-12-01 19:01:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6a2b10>
2025-12-01 19:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7800d3dd-b271-56f9-9c1d-5a1b4b402c50/7800d3dd-b271-56f9-9c1d-5a1b4b402c50_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX20XCS%252F2025-12-01%252Fimage%252Fbe057c18-49cf-4429-9c61-e5ca012cc4be_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX20XCS/2025-12-01/image/be057c18-49cf-4429-9c61-e5ca012cc4be_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7800d3dd-b271-56f9-9c1d-5a1b4b402c50
2025-12-01 19:01:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e754110>
2025-12-01 19:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f02e94-b6b8-5898-baab-8d66d2e3eb15/15f02e94-b6b8-5898-baab-8d66d2e3eb15_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fd8ed44f8-6a5e-43ce-96a5-89e8d6d1f331.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/d8ed44f8-6a5e-43ce-96a5-89e8d6d1f331.jpg?w=600 saved to cache
2025-12-01 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 15f02e94-b6b8-5898-baab-8d66d2e3eb15
2025-12-01 19:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/2f85869f-2884-4399-90ff-ab98d096188d.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117566737?view=catalogue)
2025-12-01 19:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/b0b3254f-3a2f-4541-8ae0-ac7773d398d9.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117583554?view=catalogue)
2025-12-01 19:01:04 [astonbarclay.gb] INFO: Found listing with ID: 117573681
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573681%27 HTTP/1.1" 200 None
2025-12-01 19:01:04 [astonbarclay.gb] INFO: Scrape type for 117573681: 0
2025-12-01 19:01:04 [astonbarclay.gb] INFO: Found listing with ID: 117522892
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117522892%27 HTTP/1.1" 200 None
2025-12-01 19:01:04 [astonbarclay.gb] INFO: Scrape type for 117522892: 0
2025-12-01 19:01:04 [astonbarclay.gb] INFO: Found listing with ID: 117507378
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507378%27 HTTP/1.1" 200 None
2025-12-01 19:01:04 [astonbarclay.gb] INFO: Scrape type for 117507378: 0
2025-12-01 19:01:04 [astonbarclay.gb] INFO: Found listing with ID: 117507367
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507367%27 HTTP/1.1" 200 None
2025-12-01 19:01:04 [astonbarclay.gb] INFO: Scrape type for 117507367: 0
2025-12-01 19:01:04 [astonbarclay.gb] INFO: Found listing with ID: 117507387
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507387%27 HTTP/1.1" 200 None
2025-12-01 19:01:04 [astonbarclay.gb] INFO: Scrape type for 117507387: 0
2025-12-01 19:01:04 [astonbarclay.gb] INFO: Found listing with ID: 117589550
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117589550%27 HTTP/1.1" 200 None
2025-12-01 19:01:04 [astonbarclay.gb] INFO: Scrape type for 117589550: 1
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX20XCS%252F2025-12-01%252Fimage%252Fea315940-8e43-49ec-9a90-f19bdbd26be1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX20XCS/2025-12-01/image/ea315940-8e43-49ec-9a90-f19bdbd26be1_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/d4c1a4bf-a4c8-4e32-b772-a4a41eec71d7.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117583554?view=catalogue)
2025-12-01 19:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV71RCF/2025-12-01/image/cf1d424d-c51c-4533-bfd8-29af3f745ec4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549131?view=catalogue)
2025-12-01 19:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RA18NAU/2025-12-01/image/9cbfa473-d91a-485a-84b2-411e5b067827_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616319?view=catalogue)
2025-12-01 19:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AX19OCE/2025-12-01/image/9bd2475c-1a8f-45a0-bd60-332edfb22ec1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117592979?view=catalogue)
2025-12-01 19:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RA18NAU/2025-12-01/image/8ee310ba-26b5-4480-8f9b-d2e9bcd5ffcb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616319?view=catalogue)
2025-12-01 19:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/f5f6f6ac-35d9-4ff9-97b4-6b0d2c3fede0.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117563502?view=catalogue)
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAX19OCE%252F2025-12-01%252Fimage%252F4e4023df-36dc-4957-8545-b41f12bda182_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19OCE/2025-12-01/image/4e4023df-36dc-4957-8545-b41f12bda182_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRA18NAU%252F2025-12-01%252Fimage%252Fd26149cc-34e1-46bc-95e8-e0896c22025b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RA18NAU/2025-12-01/image/d26149cc-34e1-46bc-95e8-e0896c22025b_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fa59cfbe9-8ba6-4daf-997d-267dc8922808.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/a59cfbe9-8ba6-4daf-997d-267dc8922808.jpg?w=600 not downloaded yet
2025-12-01 19:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e777090>
2025-12-01 19:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab7e8163-878a-5bd5-bf93-2903eae01623/ab7e8163-878a-5bd5-bf93-2903eae01623_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAX19OCE%252F2025-12-01%252Fimage%252Fab423de8-5422-4764-ab54-6b073aec3eed_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19OCE/2025-12-01/image/ab423de8-5422-4764-ab54-6b073aec3eed_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab7e8163-878a-5bd5-bf93-2903eae01623
2025-12-01 19:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e7752d0>
2025-12-01 19:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-01 19:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1e54fb1-db98-567f-aff3-be7b913fc33c/a1e54fb1-db98-567f-aff3-be7b913fc33c_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRA18NAU%252F2025-12-01%252Fimage%252Fcd3d292a-7e9a-450b-a3d1-c410331ea832_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RA18NAU/2025-12-01/image/cd3d292a-7e9a-450b-a3d1-c410331ea832_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1e54fb1-db98-567f-aff3-be7b913fc33c
2025-12-01 19:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e52aa10>
2025-12-01 19:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6df76f5-230a-5312-9d25-ecfb29918ae6/b6df76f5-230a-5312-9d25-ecfb29918ae6_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fe3534934-bd99-4ab8-a29b-1648025deade.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/e3534934-bd99-4ab8-a29b-1648025deade.jpg?w=600 saved to cache
2025-12-01 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6df76f5-230a-5312-9d25-ecfb29918ae6
2025-12-01 19:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6b8990>
2025-12-01 19:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f02e94-b6b8-5898-baab-8d66d2e3eb15/15f02e94-b6b8-5898-baab-8d66d2e3eb15_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Ff4fa26c8-b4ad-4f2c-af2d-df9b23841ada.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/f4fa26c8-b4ad-4f2c-af2d-df9b23841ada.jpg?w=600 saved to cache
2025-12-01 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 15f02e94-b6b8-5898-baab-8d66d2e3eb15
2025-12-01 19:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e705810>
2025-12-01 19:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c28ca92-e6d5-5e58-b0d2-611709a3df7b/3c28ca92-e6d5-5e58-b0d2-611709a3df7b_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV71RCF%252F2025-12-01%252Fimage%252F5a662e02-9baa-4209-b786-b4816d697f1f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV71RCF/2025-12-01/image/5a662e02-9baa-4209-b786-b4816d697f1f_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c28ca92-e6d5-5e58-b0d2-611709a3df7b
2025-12-01 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/2c20bbba-5998-4c4d-be27-2046982c5dc9.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117563502?view=catalogue)
2025-12-01 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/d1822131-1401-4990-b1a1-1e858ca841bc.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117548417?view=catalogue)
2025-12-01 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/c31e1f37-399a-431a-a685-d86357edb54f.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117583554?view=catalogue)
2025-12-01 19:01:06 [scrapy.extensions.logstats] INFO: Crawled 50 pages (at 50 pages/min), scraped 15 items (at 15 items/min)
2025-12-01 19:01:06 [astonbarclay.gb] INFO: Found listing with ID: 117366956
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117366956%27 HTTP/1.1" 200 None
2025-12-01 19:01:06 [astonbarclay.gb] INFO: Scrape type for 117366956: 0
2025-12-01 19:01:06 [astonbarclay.gb] INFO: Found listing with ID: 117444820
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117444820%27 HTTP/1.1" 200 None
2025-12-01 19:01:06 [astonbarclay.gb] INFO: Scrape type for 117444820: 0
2025-12-01 19:01:06 [astonbarclay.gb] INFO: Found listing with ID: 117231043
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117231043%27 HTTP/1.1" 200 None
2025-12-01 19:01:06 [astonbarclay.gb] INFO: Scrape type for 117231043: 0
2025-12-01 19:01:06 [astonbarclay.gb] INFO: Found listing with ID: 117599215
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599215%27 HTTP/1.1" 200 None
2025-12-01 19:01:06 [astonbarclay.gb] INFO: Scrape type for 117599215: 0
2025-12-01 19:01:06 [astonbarclay.gb] INFO: Found listing with ID: 117015819
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117015819%27 HTTP/1.1" 200 None
2025-12-01 19:01:06 [astonbarclay.gb] INFO: Scrape type for 117015819: 0
2025-12-01 19:01:06 [astonbarclay.gb] INFO: Found listing with ID: 117451336
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117451336%27 HTTP/1.1" 200 None
2025-12-01 19:01:06 [astonbarclay.gb] INFO: Scrape type for 117451336: 0
2025-12-01 19:01:06 [astonbarclay.gb] INFO: Found listing with ID: 117240480
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117240480%27 HTTP/1.1" 200 None
2025-12-01 19:01:06 [astonbarclay.gb] INFO: Scrape type for 117240480: 0
2025-12-01 19:01:06 [astonbarclay.gb] INFO: Found listing with ID: 117548403
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117548403%27 HTTP/1.1" 200 None
2025-12-01 19:01:06 [astonbarclay.gb] INFO: Scrape type for 117548403: 1
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX20XCS%252F2025-12-01%252Fimage%252F7b245dc6-60f8-42f7-b646-67b0d3916239_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX20XCS/2025-12-01/image/7b245dc6-60f8-42f7-b646-67b0d3916239_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e63d390>
2025-12-01 19:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6df76f5-230a-5312-9d25-ecfb29918ae6/b6df76f5-230a-5312-9d25-ecfb29918ae6_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F1ab4000c-3b01-470f-87b2-02bb7e3825af.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/1ab4000c-3b01-470f-87b2-02bb7e3825af.jpg?w=600 saved to cache
2025-12-01 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b6df76f5-230a-5312-9d25-ecfb29918ae6
2025-12-01 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/49c3d84c-f620-4baa-a00a-4f03d0dace26.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117566737?view=catalogue)
2025-12-01 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HT19ODX/2025-11-12/image/cdcc65c6-9647-4e07-af4b-4da74194aa5c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117002721?view=catalogue)
2025-12-01 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX20XCS/2025-12-01/image/9718708b-b93c-4ca1-8b3a-8e1ab8f38740_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549150?view=catalogue)
2025-12-01 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/0cc242f7-9ab8-4fa1-94bd-2ff0d7259aa8.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117548417?view=catalogue)
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAX19OCE%252F2025-12-01%252Fimage%252F5f43a055-a446-4d28-a98c-f584e0627747_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19OCE/2025-12-01/image/5f43a055-a446-4d28-a98c-f584e0627747_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRA18NAU%252F2025-12-01%252Fimage%252F43ff0210-53c2-4142-bff3-7ff29517713b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RA18NAU/2025-12-01/image/43ff0210-53c2-4142-bff3-7ff29517713b_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6bb610>
2025-12-01 19:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fa6f041-4a63-54f8-a2e4-1ead2b370bf2/0fa6f041-4a63-54f8-a2e4-1ead2b370bf2_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F2f85869f-2884-4399-90ff-ab98d096188d.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/2f85869f-2884-4399-90ff-ab98d096188d.jpg?w=600 saved to cache
2025-12-01 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0fa6f041-4a63-54f8-a2e4-1ead2b370bf2
2025-12-01 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX20XCS/2025-12-01/image/c19aab74-26a0-4bff-bff0-d40950415a78_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549150?view=catalogue)
2025-12-01 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HT19ODX/2025-11-12/image/c8d6436d-822f-4390-91d8-ade87ccd6914_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117002721?view=catalogue)
2025-12-01 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/5ca83b90-4a41-40ad-8503-36d58d241517.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117583554?view=catalogue)
2025-12-01 19:01:06 [astonbarclay.gb] INFO: Found listing with ID: 117615455
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615455%27 HTTP/1.1" 200 None
2025-12-01 19:01:06 [astonbarclay.gb] INFO: Scrape type for 117615455: 0
2025-12-01 19:01:06 [astonbarclay.gb] INFO: Found listing with ID: 117615989
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615989%27 HTTP/1.1" 200 None
2025-12-01 19:01:06 [astonbarclay.gb] INFO: Scrape type for 117615989: 0
2025-12-01 19:01:06 [astonbarclay.gb] INFO: Found listing with ID: 117615634
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615634%27 HTTP/1.1" 200 None
2025-12-01 19:01:06 [astonbarclay.gb] INFO: Scrape type for 117615634: 0
2025-12-01 19:01:06 [astonbarclay.gb] INFO: Found listing with ID: 117597433
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117597433%27 HTTP/1.1" 200 None
2025-12-01 19:01:06 [astonbarclay.gb] INFO: Scrape type for 117597433: 0
2025-12-01 19:01:06 [astonbarclay.gb] INFO: Found listing with ID: 117613969
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117613969%27 HTTP/1.1" 200 None
2025-12-01 19:01:06 [astonbarclay.gb] INFO: Scrape type for 117613969: 0
2025-12-01 19:01:06 [astonbarclay.gb] INFO: Found listing with ID: 117616597
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117616597%27 HTTP/1.1" 200 None
2025-12-01 19:01:06 [astonbarclay.gb] INFO: Scrape type for 117616597: 0
2025-12-01 19:01:06 [astonbarclay.gb] INFO: Found listing with ID: 117614020
2025-12-01 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117614020%27 HTTP/1.1" 200 None
2025-12-01 19:01:07 [astonbarclay.gb] INFO: Scrape type for 117614020: 0
2025-12-01 19:01:07 [astonbarclay.gb] INFO: Found listing with ID: 117616437
2025-12-01 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117616437%27 HTTP/1.1" 200 None
2025-12-01 19:01:07 [astonbarclay.gb] INFO: Scrape type for 117616437: 1
2025-12-01 19:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f23c610>
2025-12-01 19:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6df76f5-230a-5312-9d25-ecfb29918ae6/b6df76f5-230a-5312-9d25-ecfb29918ae6_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fb0b3254f-3a2f-4541-8ae0-ac7773d398d9.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/b0b3254f-3a2f-4541-8ae0-ac7773d398d9.jpg?w=600 saved to cache
2025-12-01 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b6df76f5-230a-5312-9d25-ecfb29918ae6
2025-12-01 19:01:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e977210>
2025-12-01 19:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6df76f5-230a-5312-9d25-ecfb29918ae6/b6df76f5-230a-5312-9d25-ecfb29918ae6_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fd4c1a4bf-a4c8-4e32-b772-a4a41eec71d7.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/d4c1a4bf-a4c8-4e32-b772-a4a41eec71d7.jpg?w=600 saved to cache
2025-12-01 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b6df76f5-230a-5312-9d25-ecfb29918ae6
2025-12-01 19:01:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f50661328d0>
2025-12-01 19:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c28ca92-e6d5-5e58-b0d2-611709a3df7b/3c28ca92-e6d5-5e58-b0d2-611709a3df7b_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV71RCF%252F2025-12-01%252Fimage%252Fcf1d424d-c51c-4533-bfd8-29af3f745ec4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV71RCF/2025-12-01/image/cf1d424d-c51c-4533-bfd8-29af3f745ec4_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c28ca92-e6d5-5e58-b0d2-611709a3df7b
2025-12-01 19:01:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f3df850>
2025-12-01 19:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1e54fb1-db98-567f-aff3-be7b913fc33c/a1e54fb1-db98-567f-aff3-be7b913fc33c_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRA18NAU%252F2025-12-01%252Fimage%252F9cbfa473-d91a-485a-84b2-411e5b067827_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RA18NAU/2025-12-01/image/9cbfa473-d91a-485a-84b2-411e5b067827_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1e54fb1-db98-567f-aff3-be7b913fc33c
2025-12-01 19:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f244b10>
2025-12-01 19:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab7e8163-878a-5bd5-bf93-2903eae01623/ab7e8163-878a-5bd5-bf93-2903eae01623_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAX19OCE%252F2025-12-01%252Fimage%252F9bd2475c-1a8f-45a0-bd60-332edfb22ec1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19OCE/2025-12-01/image/9bd2475c-1a8f-45a0-bd60-332edfb22ec1_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ab7e8163-878a-5bd5-bf93-2903eae01623
2025-12-01 19:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f23c650>
2025-12-01 19:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1e54fb1-db98-567f-aff3-be7b913fc33c/a1e54fb1-db98-567f-aff3-be7b913fc33c_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRA18NAU%252F2025-12-01%252Fimage%252F8ee310ba-26b5-4480-8f9b-d2e9bcd5ffcb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RA18NAU/2025-12-01/image/8ee310ba-26b5-4480-8f9b-d2e9bcd5ffcb_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1e54fb1-db98-567f-aff3-be7b913fc33c
2025-12-01 19:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f2dab90>
2025-12-01 19:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f02e94-b6b8-5898-baab-8d66d2e3eb15/15f02e94-b6b8-5898-baab-8d66d2e3eb15_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Ff5f6f6ac-35d9-4ff9-97b4-6b0d2c3fede0.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/f5f6f6ac-35d9-4ff9-97b4-6b0d2c3fede0.jpg?w=600 saved to cache
2025-12-01 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 15f02e94-b6b8-5898-baab-8d66d2e3eb15
2025-12-01 19:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/e7989f49-9b1e-49d7-941f-e6f5f99514e7.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117566737?view=catalogue)
2025-12-01 19:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/0d7e25d6-9d86-4895-bd20-b20f3c612211.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117566737?view=catalogue)
2025-12-01 19:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RA18NAU/2025-12-01/image/ce665d6f-29db-4313-937c-8238eace441b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616319?view=catalogue)
2025-12-01 19:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/bbe79802-4288-4f39-a155-fe0903347232.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117548417?view=catalogue)
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAX19OCE%252F2025-12-01%252Fimage%252Fc04ed6f9-e91c-4cfe-a1df-132b93008d26_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19OCE/2025-12-01/image/c04ed6f9-e91c-4cfe-a1df-132b93008d26_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRA18NAU%252F2025-12-01%252Fimage%252F9cfb9f61-3f90-4006-b345-35f4299f102c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RA18NAU/2025-12-01/image/9cfb9f61-3f90-4006-b345-35f4299f102c_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f2c3010>
2025-12-01 19:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f02e94-b6b8-5898-baab-8d66d2e3eb15/15f02e94-b6b8-5898-baab-8d66d2e3eb15_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F2c20bbba-5998-4c4d-be27-2046982c5dc9.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/2c20bbba-5998-4c4d-be27-2046982c5dc9.jpg?w=600 saved to cache
2025-12-01 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 15f02e94-b6b8-5898-baab-8d66d2e3eb15
2025-12-01 19:01:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 15f02e94-b6b8-5898-baab-8d66d2e3eb15, skipping ID generation
2025-12-01 19:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15f02e94-b6b8-5898-baab-8d66d2e3eb15 with scrape type 1
2025-12-01 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 15f02e94-b6b8-5898-baab-8d66d2e3eb15 from tracking dictionaries
2025-12-01 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 15f02e94-b6b8-5898-baab-8d66d2e3eb15 sending to next pipeline
2025-12-01 19:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 15f02e94-b6b8-5898-baab-8d66d2e3eb15, identifier: 117563502
2025-12-01 19:01:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e974410>
2025-12-01 19:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ea4de05-9f41-53bd-8eb6-ee24111cb1a7/8ea4de05-9f41-53bd-8eb6-ee24111cb1a7_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fd1822131-1401-4990-b1a1-1e858ca841bc.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/d1822131-1401-4990-b1a1-1e858ca841bc.jpg?w=600 saved to cache
2025-12-01 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ea4de05-9f41-53bd-8eb6-ee24111cb1a7
2025-12-01 19:01:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e822f50>
2025-12-01 19:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6df76f5-230a-5312-9d25-ecfb29918ae6/b6df76f5-230a-5312-9d25-ecfb29918ae6_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fc31e1f37-399a-431a-a685-d86357edb54f.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/c31e1f37-399a-431a-a685-d86357edb54f.jpg?w=600 saved to cache
2025-12-01 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b6df76f5-230a-5312-9d25-ecfb29918ae6
2025-12-01 19:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AX19OCE/2025-12-01/image/b4ed5a7a-79a4-4ca3-9975-2aa43396a084_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117592979?view=catalogue)
2025-12-01 19:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX20XCS/2025-12-01/image/ea315940-8e43-49ec-9a90-f19bdbd26be1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549150?view=catalogue)
2025-12-01 19:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RA18NAU/2025-12-01/image/07965700-b2b4-4363-b818-925b32a4f813_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616319?view=catalogue)
2025-12-01 19:01:10 [astonbarclay.gb] INFO: Found listing with ID: 117615786
2025-12-01 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615786%27 HTTP/1.1" 200 None
2025-12-01 19:01:10 [astonbarclay.gb] INFO: Scrape type for 117615786: 0
2025-12-01 19:01:10 [astonbarclay.gb] INFO: Found listing with ID: 117623725
2025-12-01 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117623725%27 HTTP/1.1" 200 None
2025-12-01 19:01:10 [astonbarclay.gb] INFO: Scrape type for 117623725: 1
2025-12-01 19:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 15f02e94-b6b8-5898-baab-8d66d2e3eb15 with identifier: 117563502
2025-12-01 19:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 15f02e94-b6b8-5898-baab-8d66d2e3eb15 with identifier: 117563502
2025-12-01 19:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 15f02e94-b6b8-5898-baab-8d66d2e3eb15 with identifier: 117563502 to the API
2025-12-01 19:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/2c20bbba-5998-4c4d-be27-2046982c5dc9.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.3L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '15f02e94-b6b8-5898-baab-8d66d2e3eb15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WV68ZBX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117563502',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MITSUBISHI',
 'model': 'OUTLANDER DIESEL ESTATE',
 'odometer': 55097,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f02e94-b6b8-5898-baab-8d66d2e3eb15/15f02e94-b6b8-5898-baab-8d66d2e3eb15_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61578,
             'Height': 479,
             'OriginUrl': 'https://abimg002.imgix.net/d8ed44f8-6a5e-43ce-96a5-89e8d6d1f331.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f02e94-b6b8-5898-baab-8d66d2e3eb15/15f02e94-b6b8-5898-baab-8d66d2e3eb15_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57357,
             'Height': 479,
             'OriginUrl': 'https://abimg002.imgix.net/f4fa26c8-b4ad-4f2c-af2d-df9b23841ada.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f02e94-b6b8-5898-baab-8d66d2e3eb15/15f02e94-b6b8-5898-baab-8d66d2e3eb15_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67003,
             'Height': 479,
             'OriginUrl': 'https://abimg002.imgix.net/f5f6f6ac-35d9-4ff9-97b4-6b0d2c3fede0.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f02e94-b6b8-5898-baab-8d66d2e3eb15/15f02e94-b6b8-5898-baab-8d66d2e3eb15_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42701,
             'Height': 479,
             'OriginUrl': 'https://abimg002.imgix.net/2c20bbba-5998-4c4d-be27-2046982c5dc9.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-28',
 'seller_name': 'Hedin Automotive BMW',
 'title': 'MITSUBISHI OUTLANDER DIESEL ESTATE 2.2 DI-D 4 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.2 DI-D 4 5dr Auto',
 'vin': None,
 'year': 2018}
2025-12-01 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117563502%27 HTTP/1.1" 200 None
2025-12-01 19:01:10 [astonbarclay.gb] INFO: Saving data for 117563502: {'created_time': 1764615670.677686, 'last_price_update_time': 1764615670.677698, 'auction_closing_time': 1764756000.0}
2025-12-01 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117563502') HTTP/1.1" 204 0
2025-12-01 19:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e57bc50>
2025-12-01 19:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fa6f041-4a63-54f8-a2e4-1ead2b370bf2/0fa6f041-4a63-54f8-a2e4-1ead2b370bf2_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F49c3d84c-f620-4baa-a00a-4f03d0dace26.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/49c3d84c-f620-4baa-a00a-4f03d0dace26.jpg?w=600 saved to cache
2025-12-01 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0fa6f041-4a63-54f8-a2e4-1ead2b370bf2
2025-12-01 19:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e617790>
2025-12-01 19:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4712bc-835e-5d1b-8a87-785ebf261f12/eb4712bc-835e-5d1b-8a87-785ebf261f12_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHT19ODX%252F2025-11-12%252Fimage%252Fcdcc65c6-9647-4e07-af4b-4da74194aa5c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT19ODX/2025-11-12/image/cdcc65c6-9647-4e07-af4b-4da74194aa5c_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb4712bc-835e-5d1b-8a87-785ebf261f12
2025-12-01 19:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e69c350>
2025-12-01 19:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7800d3dd-b271-56f9-9c1d-5a1b4b402c50/7800d3dd-b271-56f9-9c1d-5a1b4b402c50_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX20XCS%252F2025-12-01%252Fimage%252F9718708b-b93c-4ca1-8b3a-8e1ab8f38740_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX20XCS/2025-12-01/image/9718708b-b93c-4ca1-8b3a-8e1ab8f38740_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7800d3dd-b271-56f9-9c1d-5a1b4b402c50
2025-12-01 19:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e766a10>
2025-12-01 19:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ea4de05-9f41-53bd-8eb6-ee24111cb1a7/8ea4de05-9f41-53bd-8eb6-ee24111cb1a7_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F0cc242f7-9ab8-4fa1-94bd-2ff0d7259aa8.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/0cc242f7-9ab8-4fa1-94bd-2ff0d7259aa8.jpg?w=600 saved to cache
2025-12-01 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8ea4de05-9f41-53bd-8eb6-ee24111cb1a7
2025-12-01 19:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AX19OCE/2025-12-01/image/2cac4f0d-61b6-4d61-ab6d-47af306347f5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117592979?view=catalogue)
2025-12-01 19:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/a59cfbe9-8ba6-4daf-997d-267dc8922808.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117548417?view=catalogue)
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAX19OCE%252F2025-12-01%252Fimage%252F3c18cc03-d1e5-45fa-a525-1e2ebe93f2b7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19OCE/2025-12-01/image/3c18cc03-d1e5-45fa-a525-1e2ebe93f2b7_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRA18NAU%252F2025-12-01%252Fimage%252F53289123-b2a4-4ef5-8530-a1f945875b1e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RA18NAU/2025-12-01/image/53289123-b2a4-4ef5-8530-a1f945875b1e_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e7eb5d0>
2025-12-01 19:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7800d3dd-b271-56f9-9c1d-5a1b4b402c50/7800d3dd-b271-56f9-9c1d-5a1b4b402c50_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX20XCS%252F2025-12-01%252Fimage%252Fc19aab74-26a0-4bff-bff0-d40950415a78_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX20XCS/2025-12-01/image/c19aab74-26a0-4bff-bff0-d40950415a78_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7800d3dd-b271-56f9-9c1d-5a1b4b402c50
2025-12-01 19:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e745c10>
2025-12-01 19:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4712bc-835e-5d1b-8a87-785ebf261f12/eb4712bc-835e-5d1b-8a87-785ebf261f12_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHT19ODX%252F2025-11-12%252Fimage%252Fc8d6436d-822f-4390-91d8-ade87ccd6914_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT19ODX/2025-11-12/image/c8d6436d-822f-4390-91d8-ade87ccd6914_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb4712bc-835e-5d1b-8a87-785ebf261f12
2025-12-01 19:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f23f390>
2025-12-01 19:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6df76f5-230a-5312-9d25-ecfb29918ae6/b6df76f5-230a-5312-9d25-ecfb29918ae6_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F5ca83b90-4a41-40ad-8503-36d58d241517.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/5ca83b90-4a41-40ad-8503-36d58d241517.jpg?w=600 saved to cache
2025-12-01 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b6df76f5-230a-5312-9d25-ecfb29918ae6
2025-12-01 19:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX20XCS/2025-12-01/image/7b245dc6-60f8-42f7-b646-67b0d3916239_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549150?view=catalogue)
2025-12-01 19:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AX19OCE/2025-12-01/image/4e4023df-36dc-4957-8545-b41f12bda182_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117592979?view=catalogue)
2025-12-01 19:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RA18NAU/2025-12-01/image/d26149cc-34e1-46bc-95e8-e0896c22025b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616319?view=catalogue)
2025-12-01 19:01:12 [astonbarclay.gb] INFO: Found listing with ID: 116617318
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116617318%27 HTTP/1.1" 200 None
2025-12-01 19:01:12 [astonbarclay.gb] INFO: Scrape type for 116617318: 0
2025-12-01 19:01:12 [astonbarclay.gb] INFO: Found listing with ID: 117587813
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117587813%27 HTTP/1.1" 200 None
2025-12-01 19:01:12 [astonbarclay.gb] INFO: Scrape type for 117587813: 0
2025-12-01 19:01:12 [astonbarclay.gb] INFO: Found listing with ID: 117563927
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117563927%27 HTTP/1.1" 200 None
2025-12-01 19:01:12 [astonbarclay.gb] INFO: Scrape type for 117563927: 1
2025-12-01 19:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e600690>
2025-12-01 19:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fa6f041-4a63-54f8-a2e4-1ead2b370bf2/0fa6f041-4a63-54f8-a2e4-1ead2b370bf2_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fe7989f49-9b1e-49d7-941f-e6f5f99514e7.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/e7989f49-9b1e-49d7-941f-e6f5f99514e7.jpg?w=600 saved to cache
2025-12-01 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0fa6f041-4a63-54f8-a2e4-1ead2b370bf2
2025-12-01 19:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f3c3790>
2025-12-01 19:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fa6f041-4a63-54f8-a2e4-1ead2b370bf2/0fa6f041-4a63-54f8-a2e4-1ead2b370bf2_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F0d7e25d6-9d86-4895-bd20-b20f3c612211.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/0d7e25d6-9d86-4895-bd20-b20f3c612211.jpg?w=600 saved to cache
2025-12-01 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0fa6f041-4a63-54f8-a2e4-1ead2b370bf2
2025-12-01 19:01:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0fa6f041-4a63-54f8-a2e4-1ead2b370bf2, skipping ID generation
2025-12-01 19:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fa6f041-4a63-54f8-a2e4-1ead2b370bf2 with scrape type 1
2025-12-01 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0fa6f041-4a63-54f8-a2e4-1ead2b370bf2 from tracking dictionaries
2025-12-01 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0fa6f041-4a63-54f8-a2e4-1ead2b370bf2 sending to next pipeline
2025-12-01 19:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0fa6f041-4a63-54f8-a2e4-1ead2b370bf2, identifier: 117566737
2025-12-01 19:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e909650>
2025-12-01 19:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1e54fb1-db98-567f-aff3-be7b913fc33c/a1e54fb1-db98-567f-aff3-be7b913fc33c_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRA18NAU%252F2025-12-01%252Fimage%252Fce665d6f-29db-4313-937c-8238eace441b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RA18NAU/2025-12-01/image/ce665d6f-29db-4313-937c-8238eace441b_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1e54fb1-db98-567f-aff3-be7b913fc33c
2025-12-01 19:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6a8190>
2025-12-01 19:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ea4de05-9f41-53bd-8eb6-ee24111cb1a7/8ea4de05-9f41-53bd-8eb6-ee24111cb1a7_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fbbe79802-4288-4f39-a155-fe0903347232.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/bbe79802-4288-4f39-a155-fe0903347232.jpg?w=600 saved to cache
2025-12-01 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8ea4de05-9f41-53bd-8eb6-ee24111cb1a7
2025-12-01 19:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV71RCF/2025-12-01/image/30d580c3-ef46-410b-bb0f-8511444dffb4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549131?view=catalogue)
2025-12-01 19:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AX19OCE/2025-12-01/image/5f43a055-a446-4d28-a98c-f584e0627747_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117592979?view=catalogue)
2025-12-01 19:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AX19OCE/2025-12-01/image/4d202cf2-7af0-4b1c-ac8d-9f63083181e2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117592979?view=catalogue)
2025-12-01 19:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RA18NAU/2025-12-01/image/43ff0210-53c2-4142-bff3-7ff29517713b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616319?view=catalogue)
2025-12-01 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRA18NAU%252F2025-12-01%252Fimage%252F085d6eeb-6001-4f87-afe8-1e087ecb3481_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RA18NAU/2025-12-01/image/085d6eeb-6001-4f87-afe8-1e087ecb3481_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0fa6f041-4a63-54f8-a2e4-1ead2b370bf2 with identifier: 117566737
2025-12-01 19:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0fa6f041-4a63-54f8-a2e4-1ead2b370bf2 with identifier: 117566737
2025-12-01 19:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0fa6f041-4a63-54f8-a2e4-1ead2b370bf2 with identifier: 117566737 to the API
2025-12-01 19:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/0d7e25d6-9d86-4895-bd20-b20f3c612211.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '0fa6f041-4a63-54f8-a2e4-1ead2b370bf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LY18UES',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117566737',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '5 SERIES DIESEL SALOON',
 'odometer': 58457,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fa6f041-4a63-54f8-a2e4-1ead2b370bf2/0fa6f041-4a63-54f8-a2e4-1ead2b370bf2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54292,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/2f85869f-2884-4399-90ff-ab98d096188d.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fa6f041-4a63-54f8-a2e4-1ead2b370bf2/0fa6f041-4a63-54f8-a2e4-1ead2b370bf2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61007,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/49c3d84c-f620-4baa-a00a-4f03d0dace26.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fa6f041-4a63-54f8-a2e4-1ead2b370bf2/0fa6f041-4a63-54f8-a2e4-1ead2b370bf2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56046,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/e7989f49-9b1e-49d7-941f-e6f5f99514e7.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fa6f041-4a63-54f8-a2e4-1ead2b370bf2/0fa6f041-4a63-54f8-a2e4-1ead2b370bf2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36970,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/0d7e25d6-9d86-4895-bd20-b20f3c612211.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-31',
 'seller_name': 'Hedin Automotive BMW',
 'title': 'BMW 5 SERIES DIESEL SALOON 520d M Sport 4dr Auto',
 'transmission': 'automatic',
 'trim': '520d M Sport 4dr Auto',
 'vin': None,
 'year': 2018}
2025-12-01 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117566737%27 HTTP/1.1" 200 None
2025-12-01 19:01:14 [astonbarclay.gb] INFO: Saving data for 117566737: {'created_time': 1764615674.232388, 'last_price_update_time': 1764615674.2324, 'auction_closing_time': 1764756000.0}
2025-12-01 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117566737') HTTP/1.1" 204 0
2025-12-01 19:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f26ad10>
2025-12-01 19:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab7e8163-878a-5bd5-bf93-2903eae01623/ab7e8163-878a-5bd5-bf93-2903eae01623_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAX19OCE%252F2025-12-01%252Fimage%252Fb4ed5a7a-79a4-4ca3-9975-2aa43396a084_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19OCE/2025-12-01/image/b4ed5a7a-79a4-4ca3-9975-2aa43396a084_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab7e8163-878a-5bd5-bf93-2903eae01623
2025-12-01 19:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6b9bd0>
2025-12-01 19:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7800d3dd-b271-56f9-9c1d-5a1b4b402c50/7800d3dd-b271-56f9-9c1d-5a1b4b402c50_image_9.jpg HTTP/1.1" 201 0
2025-12-01 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX20XCS%252F2025-12-01%252Fimage%252Fea315940-8e43-49ec-9a90-f19bdbd26be1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX20XCS/2025-12-01/image/ea315940-8e43-49ec-9a90-f19bdbd26be1_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7800d3dd-b271-56f9-9c1d-5a1b4b402c50
2025-12-01 19:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e53a990>
2025-12-01 19:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1e54fb1-db98-567f-aff3-be7b913fc33c/a1e54fb1-db98-567f-aff3-be7b913fc33c_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRA18NAU%252F2025-12-01%252Fimage%252F07965700-b2b4-4363-b818-925b32a4f813_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RA18NAU/2025-12-01/image/07965700-b2b4-4363-b818-925b32a4f813_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1e54fb1-db98-567f-aff3-be7b913fc33c
2025-12-01 19:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HT19ODX/2025-11-12/image/7bc0a75e-3436-4b6c-a3e9-4a1537897680_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117002721?view=catalogue)
2025-12-01 19:01:15 [astonbarclay.gb] INFO: Found listing with ID: 117631028
2025-12-01 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117631028%27 HTTP/1.1" 200 None
2025-12-01 19:01:15 [astonbarclay.gb] INFO: Scrape type for 117631028: 1
2025-12-01 19:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f2680d0>
2025-12-01 19:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab7e8163-878a-5bd5-bf93-2903eae01623/ab7e8163-878a-5bd5-bf93-2903eae01623_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAX19OCE%252F2025-12-01%252Fimage%252F2cac4f0d-61b6-4d61-ab6d-47af306347f5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19OCE/2025-12-01/image/2cac4f0d-61b6-4d61-ab6d-47af306347f5_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ab7e8163-878a-5bd5-bf93-2903eae01623
2025-12-01 19:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6813d0>
2025-12-01 19:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ea4de05-9f41-53bd-8eb6-ee24111cb1a7/8ea4de05-9f41-53bd-8eb6-ee24111cb1a7_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fa59cfbe9-8ba6-4daf-997d-267dc8922808.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/a59cfbe9-8ba6-4daf-997d-267dc8922808.jpg?w=600 saved to cache
2025-12-01 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8ea4de05-9f41-53bd-8eb6-ee24111cb1a7
2025-12-01 19:01:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ea4de05-9f41-53bd-8eb6-ee24111cb1a7, skipping ID generation
2025-12-01 19:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ea4de05-9f41-53bd-8eb6-ee24111cb1a7 with scrape type 1
2025-12-01 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8ea4de05-9f41-53bd-8eb6-ee24111cb1a7 from tracking dictionaries
2025-12-01 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ea4de05-9f41-53bd-8eb6-ee24111cb1a7 sending to next pipeline
2025-12-01 19:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8ea4de05-9f41-53bd-8eb6-ee24111cb1a7, identifier: 117548417
2025-12-01 19:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AX19OCE/2025-12-01/image/c04ed6f9-e91c-4cfe-a1df-132b93008d26_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117592979?view=catalogue)
2025-12-01 19:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX20XCS/2025-12-01/image/49947d55-ecbb-492d-ac6d-d04877c6132d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549150?view=catalogue)
2025-12-01 19:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8ea4de05-9f41-53bd-8eb6-ee24111cb1a7 with identifier: 117548417
2025-12-01 19:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8ea4de05-9f41-53bd-8eb6-ee24111cb1a7 with identifier: 117548417
2025-12-01 19:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 8ea4de05-9f41-53bd-8eb6-ee24111cb1a7 with identifier: 117548417 to the API
2025-12-01 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/a59cfbe9-8ba6-4daf-997d-267dc8922808.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '8ea4de05-9f41-53bd-8eb6-ee24111cb1a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BV66OOB',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117548417',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'Q7 DIESEL ESTATE',
 'odometer': 85130,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea4de05-9f41-53bd-8eb6-ee24111cb1a7/8ea4de05-9f41-53bd-8eb6-ee24111cb1a7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59473,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/d1822131-1401-4990-b1a1-1e858ca841bc.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea4de05-9f41-53bd-8eb6-ee24111cb1a7/8ea4de05-9f41-53bd-8eb6-ee24111cb1a7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43742,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/0cc242f7-9ab8-4fa1-94bd-2ff0d7259aa8.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea4de05-9f41-53bd-8eb6-ee24111cb1a7/8ea4de05-9f41-53bd-8eb6-ee24111cb1a7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32934,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/bbe79802-4288-4f39-a155-fe0903347232.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea4de05-9f41-53bd-8eb6-ee24111cb1a7/8ea4de05-9f41-53bd-8eb6-ee24111cb1a7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31271,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/a59cfbe9-8ba6-4daf-997d-267dc8922808.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-01',
 'seller_name': 'Hedin Automotive BMW',
 'title': 'AUDI Q7 DIESEL ESTATE 3.0 TDI Quattro S Line 5dr Tip Auto',
 'transmission': 'automatic',
 'trim': '3.0 TDI Quattro S Line 5dr Tip Auto',
 'vin': None,
 'year': 2016}
2025-12-01 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117548417%27 HTTP/1.1" 200 None
2025-12-01 19:01:16 [astonbarclay.gb] INFO: Saving data for 117548417: {'created_time': 1764615676.197134, 'last_price_update_time': 1764615676.197146, 'auction_closing_time': 1764756000.0}
2025-12-01 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117548417') HTTP/1.1" 204 0
2025-12-01 19:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e665490>
2025-12-01 19:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7800d3dd-b271-56f9-9c1d-5a1b4b402c50/7800d3dd-b271-56f9-9c1d-5a1b4b402c50_image_10.jpg HTTP/1.1" 201 0
2025-12-01 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX20XCS%252F2025-12-01%252Fimage%252F7b245dc6-60f8-42f7-b646-67b0d3916239_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX20XCS/2025-12-01/image/7b245dc6-60f8-42f7-b646-67b0d3916239_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 7800d3dd-b271-56f9-9c1d-5a1b4b402c50
2025-12-01 19:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f3a6990>
2025-12-01 19:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab7e8163-878a-5bd5-bf93-2903eae01623/ab7e8163-878a-5bd5-bf93-2903eae01623_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAX19OCE%252F2025-12-01%252Fimage%252F4e4023df-36dc-4957-8545-b41f12bda182_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19OCE/2025-12-01/image/4e4023df-36dc-4957-8545-b41f12bda182_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ab7e8163-878a-5bd5-bf93-2903eae01623
2025-12-01 19:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e66d510>
2025-12-01 19:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1e54fb1-db98-567f-aff3-be7b913fc33c/a1e54fb1-db98-567f-aff3-be7b913fc33c_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRA18NAU%252F2025-12-01%252Fimage%252Fd26149cc-34e1-46bc-95e8-e0896c22025b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RA18NAU/2025-12-01/image/d26149cc-34e1-46bc-95e8-e0896c22025b_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1e54fb1-db98-567f-aff3-be7b913fc33c
2025-12-01 19:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RA18NAU/2025-12-01/image/9cfb9f61-3f90-4006-b345-35f4299f102c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616319?view=catalogue)
2025-12-01 19:01:17 [astonbarclay.gb] INFO: Found listing with ID: 117638131
2025-12-01 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117638131%27 HTTP/1.1" 200 None
2025-12-01 19:01:17 [astonbarclay.gb] INFO: Scrape type for 117638131: 1
2025-12-01 19:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e88f910>
2025-12-01 19:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c28ca92-e6d5-5e58-b0d2-611709a3df7b/3c28ca92-e6d5-5e58-b0d2-611709a3df7b_image_9.jpg HTTP/1.1" 201 0
2025-12-01 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV71RCF%252F2025-12-01%252Fimage%252F30d580c3-ef46-410b-bb0f-8511444dffb4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV71RCF/2025-12-01/image/30d580c3-ef46-410b-bb0f-8511444dffb4_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c28ca92-e6d5-5e58-b0d2-611709a3df7b
2025-12-01 19:01:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c28ca92-e6d5-5e58-b0d2-611709a3df7b, skipping ID generation
2025-12-01 19:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c28ca92-e6d5-5e58-b0d2-611709a3df7b with scrape type 1
2025-12-01 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3c28ca92-e6d5-5e58-b0d2-611709a3df7b from tracking dictionaries
2025-12-01 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c28ca92-e6d5-5e58-b0d2-611709a3df7b sending to next pipeline
2025-12-01 19:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3c28ca92-e6d5-5e58-b0d2-611709a3df7b, identifier: 117549131
2025-12-01 19:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6b7990>
2025-12-01 19:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab7e8163-878a-5bd5-bf93-2903eae01623/ab7e8163-878a-5bd5-bf93-2903eae01623_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAX19OCE%252F2025-12-01%252Fimage%252F5f43a055-a446-4d28-a98c-f584e0627747_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19OCE/2025-12-01/image/5f43a055-a446-4d28-a98c-f584e0627747_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ab7e8163-878a-5bd5-bf93-2903eae01623
2025-12-01 19:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e876390>
2025-12-01 19:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab7e8163-878a-5bd5-bf93-2903eae01623/ab7e8163-878a-5bd5-bf93-2903eae01623_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAX19OCE%252F2025-12-01%252Fimage%252F4d202cf2-7af0-4b1c-ac8d-9f63083181e2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19OCE/2025-12-01/image/4d202cf2-7af0-4b1c-ac8d-9f63083181e2_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ab7e8163-878a-5bd5-bf93-2903eae01623
2025-12-01 19:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e96b050>
2025-12-01 19:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1e54fb1-db98-567f-aff3-be7b913fc33c/a1e54fb1-db98-567f-aff3-be7b913fc33c_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRA18NAU%252F2025-12-01%252Fimage%252F43ff0210-53c2-4142-bff3-7ff29517713b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RA18NAU/2025-12-01/image/43ff0210-53c2-4142-bff3-7ff29517713b_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a1e54fb1-db98-567f-aff3-be7b913fc33c
2025-12-01 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HT19ODX/2025-11-12/image/38b4cbfe-c4e5-4158-b789-72352a9a5efb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117002721?view=catalogue)
2025-12-01 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX20XCS/2025-12-01/image/05bb4e19-6169-4e76-a250-55b6df2a9397_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549150?view=catalogue)
2025-12-01 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AX19OCE/2025-12-01/image/3c18cc03-d1e5-45fa-a525-1e2ebe93f2b7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117592979?view=catalogue)
2025-12-01 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RA18NAU/2025-12-01/image/53289123-b2a4-4ef5-8530-a1f945875b1e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616319?view=catalogue)
2025-12-01 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/c40030d0-3598-463b-be8f-bc212d66e04a.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117583554?view=catalogue)
2025-12-01 19:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3c28ca92-e6d5-5e58-b0d2-611709a3df7b with identifier: 117549131
2025-12-01 19:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3c28ca92-e6d5-5e58-b0d2-611709a3df7b with identifier: 117549131
2025-12-01 19:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3c28ca92-e6d5-5e58-b0d2-611709a3df7b with identifier: 117549131 to the API
2025-12-01 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LV71RCF/2025-12-01/image/30d580c3-ef46-410b-bb0f-8511444dffb4_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '3c28ca92-e6d5-5e58-b0d2-611709a3df7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LV71RCF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117549131',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'GLB ESTATE',
 'odometer': 33401,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c28ca92-e6d5-5e58-b0d2-611709a3df7b/3c28ca92-e6d5-5e58-b0d2-611709a3df7b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36543,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV71RCF/2025-12-01/image/0ca52801-ecac-4485-bab6-adbec70ab718_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c28ca92-e6d5-5e58-b0d2-611709a3df7b/3c28ca92-e6d5-5e58-b0d2-611709a3df7b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35221,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV71RCF/2025-12-01/image/c61f9146-bf8a-4c1d-b2d7-5dfe9ad7657b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c28ca92-e6d5-5e58-b0d2-611709a3df7b/3c28ca92-e6d5-5e58-b0d2-611709a3df7b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36736,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV71RCF/2025-12-01/image/34508758-cdd5-42a8-9bf4-6131df3267eb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c28ca92-e6d5-5e58-b0d2-611709a3df7b/3c28ca92-e6d5-5e58-b0d2-611709a3df7b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33516,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV71RCF/2025-12-01/image/809d4590-4293-4d42-b8ed-66bc39ba6e76_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c28ca92-e6d5-5e58-b0d2-611709a3df7b/3c28ca92-e6d5-5e58-b0d2-611709a3df7b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39690,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV71RCF/2025-12-01/image/a84153f4-202b-4257-9620-1d034021001f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c28ca92-e6d5-5e58-b0d2-611709a3df7b/3c28ca92-e6d5-5e58-b0d2-611709a3df7b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46737,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV71RCF/2025-12-01/image/0aa2e920-125f-4c72-9656-f0bd3074991e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c28ca92-e6d5-5e58-b0d2-611709a3df7b/3c28ca92-e6d5-5e58-b0d2-611709a3df7b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38783,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV71RCF/2025-12-01/image/1a733e35-3dcc-4a34-b15a-d1e7d2dc866b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c28ca92-e6d5-5e58-b0d2-611709a3df7b/3c28ca92-e6d5-5e58-b0d2-611709a3df7b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46099,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV71RCF/2025-12-01/image/5a662e02-9baa-4209-b786-b4816d697f1f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c28ca92-e6d5-5e58-b0d2-611709a3df7b/3c28ca92-e6d5-5e58-b0d2-611709a3df7b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47134,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV71RCF/2025-12-01/image/cf1d424d-c51c-4533-bfd8-29af3f745ec4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c28ca92-e6d5-5e58-b0d2-611709a3df7b/3c28ca92-e6d5-5e58-b0d2-611709a3df7b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46581,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV71RCF/2025-12-01/image/30d580c3-ef46-410b-bb0f-8511444dffb4_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-10',
 'seller_name': 'Hedin Automotive',
 'title': 'MERCEDES-BENZ GLB ESTATE GLB 200 AMG Line 5dr 7G-Tronic',
 'transmission': 'automatic',
 'trim': 'GLB 200 AMG Line 5dr 7G-Tronic',
 'vin': None,
 'year': 2021}
2025-12-01 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549131%27 HTTP/1.1" 200 None
2025-12-01 19:01:18 [astonbarclay.gb] INFO: Saving data for 117549131: {'created_time': 1764615678.728543, 'last_price_update_time': 1764615678.728554, 'auction_closing_time': 1764756000.0}
2025-12-01 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117549131') HTTP/1.1" 204 0
2025-12-01 19:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e56ed10>
2025-12-01 19:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-01 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4712bc-835e-5d1b-8a87-785ebf261f12/eb4712bc-835e-5d1b-8a87-785ebf261f12_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHT19ODX%252F2025-11-12%252Fimage%252F7bc0a75e-3436-4b6c-a3e9-4a1537897680_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT19ODX/2025-11-12/image/7bc0a75e-3436-4b6c-a3e9-4a1537897680_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb4712bc-835e-5d1b-8a87-785ebf261f12
2025-12-01 19:01:19 [astonbarclay.gb] INFO: Found listing with ID: 117543807
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117543807%27 HTTP/1.1" 200 None
2025-12-01 19:01:19 [astonbarclay.gb] INFO: Scrape type for 117543807: 0
2025-12-01 19:01:19 [astonbarclay.gb] INFO: Found listing with ID: 117491120
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117491120%27 HTTP/1.1" 200 None
2025-12-01 19:01:19 [astonbarclay.gb] INFO: Scrape type for 117491120: 0
2025-12-01 19:01:19 [astonbarclay.gb] INFO: Found listing with ID: 117345378
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117345378%27 HTTP/1.1" 200 None
2025-12-01 19:01:19 [astonbarclay.gb] INFO: Scrape type for 117345378: 0
2025-12-01 19:01:19 [astonbarclay.gb] INFO: Found listing with ID: 117471399
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117471399%27 HTTP/1.1" 200 None
2025-12-01 19:01:19 [astonbarclay.gb] INFO: Scrape type for 117471399: 0
2025-12-01 19:01:19 [astonbarclay.gb] INFO: Found listing with ID: 116997754
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116997754%27 HTTP/1.1" 200 None
2025-12-01 19:01:19 [astonbarclay.gb] INFO: Scrape type for 116997754: 1
2025-12-01 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117548403?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/115422003?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117616437?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117548415?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e66d890>
2025-12-01 19:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab7e8163-878a-5bd5-bf93-2903eae01623/ab7e8163-878a-5bd5-bf93-2903eae01623_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAX19OCE%252F2025-12-01%252Fimage%252Fc04ed6f9-e91c-4cfe-a1df-132b93008d26_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19OCE/2025-12-01/image/c04ed6f9-e91c-4cfe-a1df-132b93008d26_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ab7e8163-878a-5bd5-bf93-2903eae01623
2025-12-01 19:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e997c90>
2025-12-01 19:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7800d3dd-b271-56f9-9c1d-5a1b4b402c50/7800d3dd-b271-56f9-9c1d-5a1b4b402c50_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX20XCS%252F2025-12-01%252Fimage%252F49947d55-ecbb-492d-ac6d-d04877c6132d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX20XCS/2025-12-01/image/49947d55-ecbb-492d-ac6d-d04877c6132d_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7800d3dd-b271-56f9-9c1d-5a1b4b402c50
2025-12-01 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RA18NAU/2025-12-01/image/085d6eeb-6001-4f87-afe8-1e087ecb3481_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616319?view=catalogue)
2025-12-01 19:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e8ec650>
2025-12-01 19:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1e54fb1-db98-567f-aff3-be7b913fc33c/a1e54fb1-db98-567f-aff3-be7b913fc33c_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRA18NAU%252F2025-12-01%252Fimage%252F9cfb9f61-3f90-4006-b345-35f4299f102c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RA18NAU/2025-12-01/image/9cfb9f61-3f90-4006-b345-35f4299f102c_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a1e54fb1-db98-567f-aff3-be7b913fc33c
2025-12-01 19:01:19 [astonbarclay.gb] INFO: Found listing with ID: 117099385
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117099385%27 HTTP/1.1" 200 None
2025-12-01 19:01:19 [astonbarclay.gb] INFO: Scrape type for 117099385: 1
2025-12-01 19:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e822290>
2025-12-01 19:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4712bc-835e-5d1b-8a87-785ebf261f12/eb4712bc-835e-5d1b-8a87-785ebf261f12_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHT19ODX%252F2025-11-12%252Fimage%252F38b4cbfe-c4e5-4158-b789-72352a9a5efb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT19ODX/2025-11-12/image/38b4cbfe-c4e5-4158-b789-72352a9a5efb_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb4712bc-835e-5d1b-8a87-785ebf261f12
2025-12-01 19:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6a2050>
2025-12-01 19:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7800d3dd-b271-56f9-9c1d-5a1b4b402c50/7800d3dd-b271-56f9-9c1d-5a1b4b402c50_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX20XCS%252F2025-12-01%252Fimage%252F05bb4e19-6169-4e76-a250-55b6df2a9397_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX20XCS/2025-12-01/image/05bb4e19-6169-4e76-a250-55b6df2a9397_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7800d3dd-b271-56f9-9c1d-5a1b4b402c50
2025-12-01 19:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e820d10>
2025-12-01 19:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab7e8163-878a-5bd5-bf93-2903eae01623/ab7e8163-878a-5bd5-bf93-2903eae01623_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAX19OCE%252F2025-12-01%252Fimage%252F3c18cc03-d1e5-45fa-a525-1e2ebe93f2b7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AX19OCE/2025-12-01/image/3c18cc03-d1e5-45fa-a525-1e2ebe93f2b7_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ab7e8163-878a-5bd5-bf93-2903eae01623
2025-12-01 19:01:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab7e8163-878a-5bd5-bf93-2903eae01623, skipping ID generation
2025-12-01 19:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab7e8163-878a-5bd5-bf93-2903eae01623 with scrape type 1
2025-12-01 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ab7e8163-878a-5bd5-bf93-2903eae01623 from tracking dictionaries
2025-12-01 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab7e8163-878a-5bd5-bf93-2903eae01623 sending to next pipeline
2025-12-01 19:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ab7e8163-878a-5bd5-bf93-2903eae01623, identifier: 117592979
2025-12-01 19:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e65c790>
2025-12-01 19:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1e54fb1-db98-567f-aff3-be7b913fc33c/a1e54fb1-db98-567f-aff3-be7b913fc33c_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRA18NAU%252F2025-12-01%252Fimage%252F53289123-b2a4-4ef5-8530-a1f945875b1e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RA18NAU/2025-12-01/image/53289123-b2a4-4ef5-8530-a1f945875b1e_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a1e54fb1-db98-567f-aff3-be7b913fc33c
2025-12-01 19:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f245ad0>
2025-12-01 19:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6df76f5-230a-5312-9d25-ecfb29918ae6/b6df76f5-230a-5312-9d25-ecfb29918ae6_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fc40030d0-3598-463b-be8f-bc212d66e04a.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/c40030d0-3598-463b-be8f-bc212d66e04a.jpg?w=600 saved to cache
2025-12-01 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b6df76f5-230a-5312-9d25-ecfb29918ae6
2025-12-01 19:01:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6df76f5-230a-5312-9d25-ecfb29918ae6, skipping ID generation
2025-12-01 19:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6df76f5-230a-5312-9d25-ecfb29918ae6 with scrape type 1
2025-12-01 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b6df76f5-230a-5312-9d25-ecfb29918ae6 from tracking dictionaries
2025-12-01 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6df76f5-230a-5312-9d25-ecfb29918ae6 sending to next pipeline
2025-12-01 19:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b6df76f5-230a-5312-9d25-ecfb29918ae6, identifier: 117583554
2025-12-01 19:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV22BSX/2025-12-01/image/320ef761-bd02-47d6-b931-ef1f5cf97e6d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117576078?view=catalogue)
2025-12-01 19:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HT19ODX/2025-11-12/image/b0bfd98c-9df5-4b2a-927c-aa46691d5bd1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117002721?view=catalogue)
2025-12-01 19:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ab7e8163-878a-5bd5-bf93-2903eae01623 with identifier: 117592979
2025-12-01 19:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ab7e8163-878a-5bd5-bf93-2903eae01623 with identifier: 117592979
2025-12-01 19:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ab7e8163-878a-5bd5-bf93-2903eae01623 with identifier: 117592979 to the API
2025-12-01 19:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/AX19OCE/2025-12-01/image/3c18cc03-d1e5-45fa-a525-1e2ebe93f2b7_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.1L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ab7e8163-878a-5bd5-bf93-2903eae01623',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AX19OCE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117592979',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'FIESTA HATCHBACK',
 'odometer': 35321,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab7e8163-878a-5bd5-bf93-2903eae01623/ab7e8163-878a-5bd5-bf93-2903eae01623_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28206,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/ab423de8-5422-4764-ab54-6b073aec3eed_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab7e8163-878a-5bd5-bf93-2903eae01623/ab7e8163-878a-5bd5-bf93-2903eae01623_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30807,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/9bd2475c-1a8f-45a0-bd60-332edfb22ec1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab7e8163-878a-5bd5-bf93-2903eae01623/ab7e8163-878a-5bd5-bf93-2903eae01623_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28408,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/4d202cf2-7af0-4b1c-ac8d-9f63083181e2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab7e8163-878a-5bd5-bf93-2903eae01623/ab7e8163-878a-5bd5-bf93-2903eae01623_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26740,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/2cac4f0d-61b6-4d61-ab6d-47af306347f5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab7e8163-878a-5bd5-bf93-2903eae01623/ab7e8163-878a-5bd5-bf93-2903eae01623_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37946,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/b4ed5a7a-79a4-4ca3-9975-2aa43396a084_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab7e8163-878a-5bd5-bf93-2903eae01623/ab7e8163-878a-5bd5-bf93-2903eae01623_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68407,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/4e4023df-36dc-4957-8545-b41f12bda182_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab7e8163-878a-5bd5-bf93-2903eae01623/ab7e8163-878a-5bd5-bf93-2903eae01623_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49170,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/5f43a055-a446-4d28-a98c-f584e0627747_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab7e8163-878a-5bd5-bf93-2903eae01623/ab7e8163-878a-5bd5-bf93-2903eae01623_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34521,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/c04ed6f9-e91c-4cfe-a1df-132b93008d26_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab7e8163-878a-5bd5-bf93-2903eae01623/ab7e8163-878a-5bd5-bf93-2903eae01623_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50466,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/AX19OCE/2025-12-01/image/3c18cc03-d1e5-45fa-a525-1e2ebe93f2b7_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-31',
 'seller_name': 'SMC Group',
 'title': 'FORD FIESTA HATCHBACK 1.1 Zetec 3dr',
 'transmission': 'manual',
 'trim': '1.1 Zetec 3dr',
 'vin': None,
 'year': 2019}
2025-12-01 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117592979%27 HTTP/1.1" 200 None
2025-12-01 19:01:21 [astonbarclay.gb] INFO: Saving data for 117592979: {'created_time': 1764615681.722757, 'last_price_update_time': 1764615681.722767, 'auction_closing_time': 1764756000.0}
2025-12-01 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117592979') HTTP/1.1" 204 0
2025-12-01 19:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b6df76f5-230a-5312-9d25-ecfb29918ae6 with identifier: 117583554
2025-12-01 19:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b6df76f5-230a-5312-9d25-ecfb29918ae6 with identifier: 117583554
2025-12-01 19:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b6df76f5-230a-5312-9d25-ecfb29918ae6 with identifier: 117583554 to the API
2025-12-01 19:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/c40030d0-3598-463b-be8f-bc212d66e04a.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'b6df76f5-230a-5312-9d25-ecfb29918ae6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LX69ZCA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117583554',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '4 SERIES COUPE',
 'odometer': 36190,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6df76f5-230a-5312-9d25-ecfb29918ae6/b6df76f5-230a-5312-9d25-ecfb29918ae6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83827,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/e3534934-bd99-4ab8-a29b-1648025deade.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6df76f5-230a-5312-9d25-ecfb29918ae6/b6df76f5-230a-5312-9d25-ecfb29918ae6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68941,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/1ab4000c-3b01-470f-87b2-02bb7e3825af.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6df76f5-230a-5312-9d25-ecfb29918ae6/b6df76f5-230a-5312-9d25-ecfb29918ae6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62596,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/d4c1a4bf-a4c8-4e32-b772-a4a41eec71d7.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6df76f5-230a-5312-9d25-ecfb29918ae6/b6df76f5-230a-5312-9d25-ecfb29918ae6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72974,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/5ca83b90-4a41-40ad-8503-36d58d241517.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6df76f5-230a-5312-9d25-ecfb29918ae6/b6df76f5-230a-5312-9d25-ecfb29918ae6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73955,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/b0b3254f-3a2f-4541-8ae0-ac7773d398d9.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6df76f5-230a-5312-9d25-ecfb29918ae6/b6df76f5-230a-5312-9d25-ecfb29918ae6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75828,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/c40030d0-3598-463b-be8f-bc212d66e04a.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6df76f5-230a-5312-9d25-ecfb29918ae6/b6df76f5-230a-5312-9d25-ecfb29918ae6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72850,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/c31e1f37-399a-431a-a685-d86357edb54f.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-31',
 'seller_name': 'Hedin Automotive',
 'title': 'BMW 4 SERIES COUPE 420i M Sport 2dr Auto [Professional Media]',
 'transmission': 'automatic',
 'trim': '420i M Sport 2dr Auto [Professional Media]',
 'vin': None,
 'year': 2019}
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117583554%27 HTTP/1.1" 200 None
2025-12-01 19:01:22 [astonbarclay.gb] INFO: Saving data for 117583554: {'created_time': 1764615682.202284, 'last_price_update_time': 1764615682.202295, 'auction_closing_time': 1764756000.0}
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117583554') HTTP/1.1" 204 0
2025-12-01 19:01:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117548403, 'registration': 'DC23JUU', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 19396, 'mileageWarranty': False, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 581}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-26', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service invoice 07/25-14K', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-01 19:01:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117548403, 'registration': 'DC23JUU', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 19396, 'mileageWarranty': False, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 581}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-26', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service invoice 07/25-14K', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-01 19:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5352e8ce-ef3d-5fb5-b156-d31f7be289ec with identifier: 117548403
2025-12-01 19:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5352e8ce-ef3d-5fb5-b156-d31f7be289ec with scrape type 1
2025-12-01 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 5352e8ce-ef3d-5fb5-b156-d31f7be289ec
2025-12-01 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 5352e8ce-ef3d-5fb5-b156-d31f7be289ec
2025-12-01 19:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5352e8ce-ef3d-5fb5-b156-d31f7be289ec, identifier: 117548403
2025-12-01 19:01:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 115422003, 'registration': 'A2UOV', 'account': 'STE131', 'make': 'VOLKSWAGEN', 'model': 'T-ROC HATCHBACK', 'derivative': '2.0 TSI 4MOTION R 5dr DSG', 'mileage': 57752, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-06-10', 'fuel': 'Petrol', 'motExpiry': '2025-06-09', 'doors': 5, 'engineSize': 1984, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/A2UOV/2025-09-18/image/ccc15175-e3bf-4e00-ad0d-132ada753d1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/32485ed9-e7a8-4072-8dd0-6aa655fc8b2c_removebg.jpg?w=600', 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/193d37ce-cb43-472e-9ffc-c01f047e2690_removebg.jpg?w=600', 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/b3ecb7cb-8fe0-4ff3-8538-4ab8db299eeb_removebg.jpg?w=600', 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/fe6a0c77-4db4-447f-af9e-89669cd126ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/ae94a4ee-997e-45e6-8277-7da0a0643237_removebg.jpg?w=600', 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/bf982db3-14dc-4ccf-9a01-8e41be32c5d8_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'CHERISED PLATE TO REMAIN WITH VEHICLE AS PER VENDOR', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 197, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7d439c6f-76c8-430c-9e89-a0768a6998c7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 115422003, 'registration': 'A2UOV', 'account': 'STE131', 'make': 'VOLKSWAGEN', 'model': 'T-ROC HATCHBACK', 'derivative': '2.0 TSI 4MOTION R 5dr DSG', 'mileage': 57752, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-06-10', 'fuel': 'Petrol', 'motExpiry': '2025-06-09', 'doors': 5, 'engineSize': 1984, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/A2UOV/2025-09-18/image/ccc15175-e3bf-4e00-ad0d-132ada753d1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/32485ed9-e7a8-4072-8dd0-6aa655fc8b2c_removebg.jpg?w=600', 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/193d37ce-cb43-472e-9ffc-c01f047e2690_removebg.jpg?w=600', 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/b3ecb7cb-8fe0-4ff3-8538-4ab8db299eeb_removebg.jpg?w=600', 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/fe6a0c77-4db4-447f-af9e-89669cd126ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/ae94a4ee-997e-45e6-8277-7da0a0643237_removebg.jpg?w=600', 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/bf982db3-14dc-4ccf-9a01-8e41be32c5d8_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'CHERISED PLATE TO REMAIN WITH VEHICLE AS PER VENDOR', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 197, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7d439c6f-76c8-430c-9e89-a0768a6998c7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e8ecdcf-db96-5832-a676-c26fb5f17208 with identifier: 115422003
2025-12-01 19:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e8ecdcf-db96-5832-a676-c26fb5f17208 with scrape type 1
2025-12-01 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item 5e8ecdcf-db96-5832-a676-c26fb5f17208
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FA2UOV%252F2025-09-18%252Fimage%252Fccc15175-e3bf-4e00-ad0d-132ada753d1f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/A2UOV/2025-09-18/image/ccc15175-e3bf-4e00-ad0d-132ada753d1f_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117616437, 'registration': 'LL67GVP', 'account': 'WBA003', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A180 AMG Line 5dr Auto', 'mileage': 105992, 'mileageWarranty': True, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 581}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-01-31', 'fuel': 'Petrol', 'motExpiry': '2026-08-05', 'doors': 5, 'engineSize': 1595, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LL67GVP/2025-12-01/image/2684b4b5-f27a-4ec5-9df2-78402a3ec932_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67GVP/2025-12-01/image/0deb3815-cf8a-42c5-b69b-200686c56332_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67GVP/2025-12-01/image/64bca94c-3a14-464b-8eee-169f63b687bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67GVP/2025-12-01/image/24152e49-9701-4912-a2b1-265b5a8dd3b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67GVP/2025-12-01/image/c7ddf0f7-ff4e-4390-bf5e-0538de35b916_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67GVP/2025-12-01/image/f034c8a2-dc84-4397-8de2-3604b84f9cb7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67GVP/2025-12-01/image/8a6483b1-8822-4cfc-8b04-db179dc22998_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67GVP/2025-12-01/image/16a89b3c-cd63-487f-af12-84b1a3d22f93_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67GVP/2025-12-01/image/9a25b8d0-6ad5-4202-b9b0-619877fe6421_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 02/19- 11K, 02/20- 16K, 04/21- 17K, 02/22- 27K, 07/22- 37K, 03/23- 49K, 11/24- 84K', 'remarks': 'VOSA STATES 37K, 55K, 75K, 98K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/80a5ffd9-5e8d-4c6c-9ffc-d5036d208aac.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117616437, 'registration': 'LL67GVP', 'account': 'WBA003', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A180 AMG Line 5dr Auto', 'mileage': 105992, 'mileageWarranty': True, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 581}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-01-31', 'fuel': 'Petrol', 'motExpiry': '2026-08-05', 'doors': 5, 'engineSize': 1595, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LL67GVP/2025-12-01/image/2684b4b5-f27a-4ec5-9df2-78402a3ec932_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67GVP/2025-12-01/image/0deb3815-cf8a-42c5-b69b-200686c56332_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67GVP/2025-12-01/image/64bca94c-3a14-464b-8eee-169f63b687bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67GVP/2025-12-01/image/24152e49-9701-4912-a2b1-265b5a8dd3b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67GVP/2025-12-01/image/c7ddf0f7-ff4e-4390-bf5e-0538de35b916_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67GVP/2025-12-01/image/f034c8a2-dc84-4397-8de2-3604b84f9cb7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67GVP/2025-12-01/image/8a6483b1-8822-4cfc-8b04-db179dc22998_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67GVP/2025-12-01/image/16a89b3c-cd63-487f-af12-84b1a3d22f93_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL67GVP/2025-12-01/image/9a25b8d0-6ad5-4202-b9b0-619877fe6421_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 02/19- 11K, 02/20- 16K, 04/21- 17K, 02/22- 27K, 07/22- 37K, 03/23- 49K, 11/24- 84K', 'remarks': 'VOSA STATES 37K, 55K, 75K, 98K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/80a5ffd9-5e8d-4c6c-9ffc-d5036d208aac.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ac69f87-d87d-50d2-929c-94d0a460224e with identifier: 117616437
2025-12-01 19:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ac69f87-d87d-50d2-929c-94d0a460224e with scrape type 1
2025-12-01 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 3ac69f87-d87d-50d2-929c-94d0a460224e
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL67GVP%252F2025-12-01%252Fimage%252F2684b4b5-f27a-4ec5-9df2-78402a3ec932_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67GVP/2025-12-01/image/2684b4b5-f27a-4ec5-9df2-78402a3ec932_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117548415, 'registration': 'DF23EFP', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 27862, 'mileageWarranty': False, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-27', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service invoice 11/24-19K', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117548415, 'registration': 'DF23EFP', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 27862, 'mileageWarranty': False, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-27', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service invoice 11/24-19K', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cfb03ad-19f3-5e2d-895b-d5ded5eebb59 with identifier: 117548415
2025-12-01 19:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cfb03ad-19f3-5e2d-895b-d5ded5eebb59 with scrape type 1
2025-12-01 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 2cfb03ad-19f3-5e2d-895b-d5ded5eebb59
2025-12-01 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 2cfb03ad-19f3-5e2d-895b-d5ded5eebb59
2025-12-01 19:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2cfb03ad-19f3-5e2d-895b-d5ded5eebb59, identifier: 117548415
2025-12-01 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB66AVM/2025-12-01/image/eb36ef3d-ad39-4952-9e2f-d2cd6c843415_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117583759?view=catalogue)
2025-12-01 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX20XCS/2025-12-01/image/0f10db47-9ddd-45ff-86da-1fee84a2b99b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549150?view=catalogue)
2025-12-01 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117610912
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117610912%27 HTTP/1.1" 200 None
2025-12-01 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117610912: 0
2025-12-01 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117606946
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117606946%27 HTTP/1.1" 200 None
2025-12-01 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117606946: 0
2025-12-01 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117603564
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117603564%27 HTTP/1.1" 200 None
2025-12-01 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117603564: 0
2025-12-01 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117599696
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599696%27 HTTP/1.1" 200 None
2025-12-01 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117599696: 0
2025-12-01 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117613099
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117613099%27 HTTP/1.1" 200 None
2025-12-01 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117613099: 1
2025-12-01 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117563927?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117589550?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117622575?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5352e8ce-ef3d-5fb5-b156-d31f7be289ec with identifier: 117548403
2025-12-01 19:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5352e8ce-ef3d-5fb5-b156-d31f7be289ec with identifier: 117548403
2025-12-01 19:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5352e8ce-ef3d-5fb5-b156-d31f7be289ec with identifier: 117548403 to the API
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%275352e8ce-ef3d-5fb5-b156-d31f7be289ec%27 HTTP/1.1" 200 None
2025-12-01 19:01:22 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 5352e8ce-ef3d-5fb5-b156-d31f7be289ec: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:01:21 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117548403?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '5352e8ce-ef3d-5fb5-b156-d31f7be289ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DC23JUU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117548403',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 19396,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-26',
 'seller_name': 'Accident Exchange',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2023}
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117548403%27 HTTP/1.1" 200 None
2025-12-01 19:01:22 [astonbarclay.gb] INFO: Saving data for 117548403: {'created_time': 1764615682.830117, 'last_price_update_time': 1764615682.830127, 'auction_closing_time': 1765188000.0}
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117548403') HTTP/1.1" 204 0
2025-12-01 19:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2cfb03ad-19f3-5e2d-895b-d5ded5eebb59 with identifier: 117548415
2025-12-01 19:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2cfb03ad-19f3-5e2d-895b-d5ded5eebb59 with identifier: 117548415
2025-12-01 19:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2cfb03ad-19f3-5e2d-895b-d5ded5eebb59 with identifier: 117548415 to the API
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%272cfb03ad-19f3-5e2d-895b-d5ded5eebb59%27 HTTP/1.1" 200 None
2025-12-01 19:01:23 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 2cfb03ad-19f3-5e2d-895b-d5ded5eebb59: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:01:22 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117548415?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '2cfb03ad-19f3-5e2d-895b-d5ded5eebb59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DF23EFP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117548415',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 27862,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-27',
 'seller_name': 'Accident Exchange',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2023}
2025-12-01 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117548415%27 HTTP/1.1" 200 None
2025-12-01 19:01:23 [astonbarclay.gb] INFO: Saving data for 117548415: {'created_time': 1764615683.106336, 'last_price_update_time': 1764615683.106349, 'auction_closing_time': 1765188000.0}
2025-12-01 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117548415') HTTP/1.1" 204 0
2025-12-01 19:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f228a50>
2025-12-01 19:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1e54fb1-db98-567f-aff3-be7b913fc33c/a1e54fb1-db98-567f-aff3-be7b913fc33c_image_9.jpg HTTP/1.1" 201 0
2025-12-01 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRA18NAU%252F2025-12-01%252Fimage%252F085d6eeb-6001-4f87-afe8-1e087ecb3481_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RA18NAU/2025-12-01/image/085d6eeb-6001-4f87-afe8-1e087ecb3481_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a1e54fb1-db98-567f-aff3-be7b913fc33c
2025-12-01 19:01:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1e54fb1-db98-567f-aff3-be7b913fc33c, skipping ID generation
2025-12-01 19:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1e54fb1-db98-567f-aff3-be7b913fc33c with scrape type 1
2025-12-01 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a1e54fb1-db98-567f-aff3-be7b913fc33c from tracking dictionaries
2025-12-01 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1e54fb1-db98-567f-aff3-be7b913fc33c sending to next pipeline
2025-12-01 19:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a1e54fb1-db98-567f-aff3-be7b913fc33c, identifier: 117616319
2025-12-01 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HT19ODX/2025-11-12/image/dc6660f0-875c-4fe8-becc-32ef9fe29749_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117002721?view=catalogue)
2025-12-01 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX20XCS/2025-12-01/image/91491da4-8199-44f4-90b0-2d80f5f5a373_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549150?view=catalogue)
2025-12-01 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB66AVM/2025-12-01/image/3bad41e8-555c-4d01-9e08-c58d2065170f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117583759?view=catalogue)
2025-12-01 19:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FA2UOV%252F2025-09-18%252Fimage%252F32485ed9-e7a8-4072-8dd0-6aa655fc8b2c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/A2UOV/2025-09-18/image/32485ed9-e7a8-4072-8dd0-6aa655fc8b2c_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL67GVP%252F2025-12-01%252Fimage%252F0deb3815-cf8a-42c5-b69b-200686c56332_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67GVP/2025-12-01/image/0deb3815-cf8a-42c5-b69b-200686c56332_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117623725?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a1e54fb1-db98-567f-aff3-be7b913fc33c with identifier: 117616319
2025-12-01 19:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a1e54fb1-db98-567f-aff3-be7b913fc33c with identifier: 117616319
2025-12-01 19:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a1e54fb1-db98-567f-aff3-be7b913fc33c with identifier: 117616319 to the API
2025-12-01 19:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/RA18NAU/2025-12-01/image/085d6eeb-6001-4f87-afe8-1e087ecb3481_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 176,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a1e54fb1-db98-567f-aff3-be7b913fc33c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'RA18NAU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117616319',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'KUGA ESTATE',
 'odometer': 76955,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1e54fb1-db98-567f-aff3-be7b913fc33c/a1e54fb1-db98-567f-aff3-be7b913fc33c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26555,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/RA18NAU/2025-12-01/image/cd3d292a-7e9a-450b-a3d1-c410331ea832_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1e54fb1-db98-567f-aff3-be7b913fc33c/a1e54fb1-db98-567f-aff3-be7b913fc33c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26324,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/RA18NAU/2025-12-01/image/9cbfa473-d91a-485a-84b2-411e5b067827_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1e54fb1-db98-567f-aff3-be7b913fc33c/a1e54fb1-db98-567f-aff3-be7b913fc33c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28518,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/RA18NAU/2025-12-01/image/8ee310ba-26b5-4480-8f9b-d2e9bcd5ffcb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1e54fb1-db98-567f-aff3-be7b913fc33c/a1e54fb1-db98-567f-aff3-be7b913fc33c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27977,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/RA18NAU/2025-12-01/image/07965700-b2b4-4363-b818-925b32a4f813_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1e54fb1-db98-567f-aff3-be7b913fc33c/a1e54fb1-db98-567f-aff3-be7b913fc33c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47941,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/RA18NAU/2025-12-01/image/ce665d6f-29db-4313-937c-8238eace441b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1e54fb1-db98-567f-aff3-be7b913fc33c/a1e54fb1-db98-567f-aff3-be7b913fc33c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95344,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/RA18NAU/2025-12-01/image/d26149cc-34e1-46bc-95e8-e0896c22025b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1e54fb1-db98-567f-aff3-be7b913fc33c/a1e54fb1-db98-567f-aff3-be7b913fc33c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 18807,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/RA18NAU/2025-12-01/image/43ff0210-53c2-4142-bff3-7ff29517713b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1e54fb1-db98-567f-aff3-be7b913fc33c/a1e54fb1-db98-567f-aff3-be7b913fc33c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77365,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/RA18NAU/2025-12-01/image/9cfb9f61-3f90-4006-b345-35f4299f102c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1e54fb1-db98-567f-aff3-be7b913fc33c/a1e54fb1-db98-567f-aff3-be7b913fc33c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53163,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/RA18NAU/2025-12-01/image/53289123-b2a4-4ef5-8530-a1f945875b1e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1e54fb1-db98-567f-aff3-be7b913fc33c/a1e54fb1-db98-567f-aff3-be7b913fc33c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36454,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/RA18NAU/2025-12-01/image/085d6eeb-6001-4f87-afe8-1e087ecb3481_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-20',
 'seller_name': 'UKCGR - Premium',
 'title': 'FORD KUGA ESTATE 1.5 EcoBoost ST-Line 5dr 2WD',
 'transmission': 'manual',
 'trim': '1.5 EcoBoost ST-Line 5dr 2WD',
 'vin': None,
 'year': 2018}
2025-12-01 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117616319%27 HTTP/1.1" 200 None
2025-12-01 19:01:23 [astonbarclay.gb] INFO: Saving data for 117616319: {'created_time': 1764615683.855094, 'last_price_update_time': 1764615683.855104, 'auction_closing_time': 1764756000.0}
2025-12-01 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117616319') HTTP/1.1" 204 0
2025-12-01 19:01:23 [astonbarclay.gb] INFO: Found listing with ID: 117610728
2025-12-01 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117610728%27 HTTP/1.1" 200 None
2025-12-01 19:01:23 [astonbarclay.gb] INFO: Scrape type for 117610728: 1
2025-12-01 19:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f3870d0>
2025-12-01 19:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49ea86bd-0188-543f-9dff-87dbf2d122aa/49ea86bd-0188-543f-9dff-87dbf2d122aa_image_9.jpg HTTP/1.1" 201 0
2025-12-01 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV22BSX%252F2025-12-01%252Fimage%252F320ef761-bd02-47d6-b931-ef1f5cf97e6d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV22BSX/2025-12-01/image/320ef761-bd02-47d6-b931-ef1f5cf97e6d_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 49ea86bd-0188-543f-9dff-87dbf2d122aa
2025-12-01 19:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e7e4090>
2025-12-01 19:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4712bc-835e-5d1b-8a87-785ebf261f12/eb4712bc-835e-5d1b-8a87-785ebf261f12_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHT19ODX%252F2025-11-12%252Fimage%252Fb0bfd98c-9df5-4b2a-927c-aa46691d5bd1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT19ODX/2025-11-12/image/b0bfd98c-9df5-4b2a-927c-aa46691d5bd1_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb4712bc-835e-5d1b-8a87-785ebf261f12
2025-12-01 19:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV22BSX/2025-12-01/image/121f1a1c-cae5-4087-8b77-142d917a6b27_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117576078?view=catalogue)
2025-12-01 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FA2UOV%252F2025-09-18%252Fimage%252F193d37ce-cb43-472e-9ffc-c01f047e2690_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/A2UOV/2025-09-18/image/193d37ce-cb43-472e-9ffc-c01f047e2690_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL67GVP%252F2025-12-01%252Fimage%252F64bca94c-3a14-464b-8eee-169f63b687bb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67GVP/2025-12-01/image/64bca94c-3a14-464b-8eee-169f63b687bb_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e772410>
2025-12-01 19:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91e3816c-1299-58c7-b5f9-71f70184e072/91e3816c-1299-58c7-b5f9-71f70184e072_image_9.jpg HTTP/1.1" 201 0
2025-12-01 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB66AVM%252F2025-12-01%252Fimage%252Feb36ef3d-ad39-4952-9e2f-d2cd6c843415_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB66AVM/2025-12-01/image/eb36ef3d-ad39-4952-9e2f-d2cd6c843415_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 91e3816c-1299-58c7-b5f9-71f70184e072
2025-12-01 19:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e51a950>
2025-12-01 19:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7800d3dd-b271-56f9-9c1d-5a1b4b402c50/7800d3dd-b271-56f9-9c1d-5a1b4b402c50_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX20XCS%252F2025-12-01%252Fimage%252F0f10db47-9ddd-45ff-86da-1fee84a2b99b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX20XCS/2025-12-01/image/0f10db47-9ddd-45ff-86da-1fee84a2b99b_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7800d3dd-b271-56f9-9c1d-5a1b4b402c50
2025-12-01 19:01:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117563927, 'registration': 'RXZ5279', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'CROSSLAND HATCHBACK', 'derivative': '1.2 Elite Edition 5dr', 'mileage': 27371, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 149}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2022-06-23', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117563927, 'registration': 'RXZ5279', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'CROSSLAND HATCHBACK', 'derivative': '1.2 Elite Edition 5dr', 'mileage': 27371, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 149}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2022-06-23', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c21c868-0535-53b7-8968-e21a79b42702 with identifier: 117563927
2025-12-01 19:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c21c868-0535-53b7-8968-e21a79b42702 with scrape type 1
2025-12-01 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 7c21c868-0535-53b7-8968-e21a79b42702
2025-12-01 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 7c21c868-0535-53b7-8968-e21a79b42702
2025-12-01 19:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7c21c868-0535-53b7-8968-e21a79b42702, identifier: 117563927
2025-12-01 19:01:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117589550, 'registration': 'DF23ZKW', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 21939, 'mileageWarranty': False, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-27', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service invoice 08/25-19K', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117589550, 'registration': 'DF23ZKW', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 21939, 'mileageWarranty': False, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-27', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service invoice 08/25-19K', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c1303e2-0c80-5cf1-916c-ce7405d38dde with identifier: 117589550
2025-12-01 19:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c1303e2-0c80-5cf1-916c-ce7405d38dde with scrape type 1
2025-12-01 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 3c1303e2-0c80-5cf1-916c-ce7405d38dde
2025-12-01 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 3c1303e2-0c80-5cf1-916c-ce7405d38dde
2025-12-01 19:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3c1303e2-0c80-5cf1-916c-ce7405d38dde, identifier: 117589550
2025-12-01 19:01:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117622575, 'registration': 'YB68EYD', 'account': 'STA058', 'make': 'TOYOTA', 'model': 'C-HR HATCHBACK', 'derivative': '1.8 Hybrid Design 5dr CVT', 'mileage': 67438, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 581}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-01-10', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-07-30', 'doors': 5, 'engineSize': 1798, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YB68EYD/2025-12-01/image/a73aeae7-0f3a-4387-ba2f-033e0e192672_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-01/image/4b78d472-7505-4b14-8dd8-1ec9ccead57c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-01/image/34e8c971-ed9e-4274-91ea-4acba1b07b35_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-01/image/e8d6d2cf-97a5-4f7f-814b-fae6ce538cd3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-01/image/b3d45017-8f2c-4c9d-b363-e07e5be30477_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-01/image/2ef2c559-4b24-4bd4-9ed4-aa86d937a430_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-01/image/bf073061-5882-496e-a357-cb101bf98c61_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-01/image/b80b57ff-f17c-4d88-bf34-bcee8192199a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-01/image/abd0c03b-e3a4-43a5-881a-fdf2ef75970a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-01/image/28ef779c-4b37-443f-8c37-ecc5de216dca_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 45K 50K 54K 64K', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 86, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ad299850-b5f1-4cea-959a-1f6d855d2325.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117622575, 'registration': 'YB68EYD', 'account': 'STA058', 'make': 'TOYOTA', 'model': 'C-HR HATCHBACK', 'derivative': '1.8 Hybrid Design 5dr CVT', 'mileage': 67438, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 581}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-01-10', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-07-30', 'doors': 5, 'engineSize': 1798, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YB68EYD/2025-12-01/image/a73aeae7-0f3a-4387-ba2f-033e0e192672_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-01/image/4b78d472-7505-4b14-8dd8-1ec9ccead57c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-01/image/34e8c971-ed9e-4274-91ea-4acba1b07b35_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-01/image/e8d6d2cf-97a5-4f7f-814b-fae6ce538cd3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-01/image/b3d45017-8f2c-4c9d-b363-e07e5be30477_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-01/image/2ef2c559-4b24-4bd4-9ed4-aa86d937a430_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-01/image/bf073061-5882-496e-a357-cb101bf98c61_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-01/image/b80b57ff-f17c-4d88-bf34-bcee8192199a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-01/image/abd0c03b-e3a4-43a5-881a-fdf2ef75970a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB68EYD/2025-12-01/image/28ef779c-4b37-443f-8c37-ecc5de216dca_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 45K 50K 54K 64K', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 86, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ad299850-b5f1-4cea-959a-1f6d855d2325.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b55ecf4d-4b7d-502e-8147-27eca949960d with identifier: 117622575
2025-12-01 19:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b55ecf4d-4b7d-502e-8147-27eca949960d with scrape type 1
2025-12-01 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b55ecf4d-4b7d-502e-8147-27eca949960d
2025-12-01 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYB68EYD%252F2025-12-01%252Fimage%252Fa73aeae7-0f3a-4387-ba2f-033e0e192672_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB68EYD/2025-12-01/image/a73aeae7-0f3a-4387-ba2f-033e0e192672_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB66AVM/2025-12-01/image/09dd2531-a177-4090-b146-39b989553254_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117583759?view=catalogue)
2025-12-01 19:01:25 [astonbarclay.gb] INFO: Found listing with ID: 117584951
2025-12-01 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584951%27 HTTP/1.1" 200 None
2025-12-01 19:01:25 [astonbarclay.gb] INFO: Scrape type for 117584951: 0
2025-12-01 19:01:25 [astonbarclay.gb] INFO: Found listing with ID: 117600618
2025-12-01 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600618%27 HTTP/1.1" 200 None
2025-12-01 19:01:25 [astonbarclay.gb] INFO: Scrape type for 117600618: 1
2025-12-01 19:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7c21c868-0535-53b7-8968-e21a79b42702 with identifier: 117563927
2025-12-01 19:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7c21c868-0535-53b7-8968-e21a79b42702 with identifier: 117563927
2025-12-01 19:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7c21c868-0535-53b7-8968-e21a79b42702 with identifier: 117563927 to the API
2025-12-01 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%277c21c868-0535-53b7-8968-e21a79b42702%27 HTTP/1.1" 200 None
2025-12-01 19:01:25 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 7c21c868-0535-53b7-8968-e21a79b42702: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:01:24 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117563927?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': '7c21c868-0535-53b7-8968-e21a79b42702',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'RXZ5279',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117563927',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VAUXHALL',
 'model': 'CROSSLAND HATCHBACK',
 'odometer': 27371,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-23',
 'seller_name': 'Motability Operations',
 'title': 'VAUXHALL CROSSLAND HATCHBACK 1.2 Elite Edition 5dr',
 'transmission': 'manual',
 'trim': '1.2 Elite Edition 5dr',
 'vin': None,
 'year': 2022}
2025-12-01 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117563927%27 HTTP/1.1" 200 None
2025-12-01 19:01:25 [astonbarclay.gb] INFO: Saving data for 117563927: {'created_time': 1764615685.572276, 'last_price_update_time': 1764615685.572286, 'auction_closing_time': 1765275300.0}
2025-12-01 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117563927') HTTP/1.1" 204 0
2025-12-01 19:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3c1303e2-0c80-5cf1-916c-ce7405d38dde with identifier: 117589550
2025-12-01 19:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3c1303e2-0c80-5cf1-916c-ce7405d38dde with identifier: 117589550
2025-12-01 19:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3c1303e2-0c80-5cf1-916c-ce7405d38dde with identifier: 117589550 to the API
2025-12-01 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%273c1303e2-0c80-5cf1-916c-ce7405d38dde%27 HTTP/1.1" 200 None
2025-12-01 19:01:25 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 3c1303e2-0c80-5cf1-916c-ce7405d38dde: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:01:24 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117589550?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '3c1303e2-0c80-5cf1-916c-ce7405d38dde',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DF23ZKW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117589550',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 21939,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-27',
 'seller_name': 'Accident Exchange',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2023}
2025-12-01 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117589550%27 HTTP/1.1" 200 None
2025-12-01 19:01:25 [astonbarclay.gb] INFO: Saving data for 117589550: {'created_time': 1764615685.860513, 'last_price_update_time': 1764615685.860524, 'auction_closing_time': 1765188000.0}
2025-12-01 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117589550') HTTP/1.1" 204 0
2025-12-01 19:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e60ecd0>
2025-12-01 19:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4712bc-835e-5d1b-8a87-785ebf261f12/eb4712bc-835e-5d1b-8a87-785ebf261f12_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHT19ODX%252F2025-11-12%252Fimage%252Fdc6660f0-875c-4fe8-becc-32ef9fe29749_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HT19ODX/2025-11-12/image/dc6660f0-875c-4fe8-becc-32ef9fe29749_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb4712bc-835e-5d1b-8a87-785ebf261f12
2025-12-01 19:01:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb4712bc-835e-5d1b-8a87-785ebf261f12, skipping ID generation
2025-12-01 19:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb4712bc-835e-5d1b-8a87-785ebf261f12 with scrape type 1
2025-12-01 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item eb4712bc-835e-5d1b-8a87-785ebf261f12 from tracking dictionaries
2025-12-01 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb4712bc-835e-5d1b-8a87-785ebf261f12 sending to next pipeline
2025-12-01 19:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: eb4712bc-835e-5d1b-8a87-785ebf261f12, identifier: 117002721
2025-12-01 19:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e700c90>
2025-12-01 19:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7800d3dd-b271-56f9-9c1d-5a1b4b402c50/7800d3dd-b271-56f9-9c1d-5a1b4b402c50_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX20XCS%252F2025-12-01%252Fimage%252F91491da4-8199-44f4-90b0-2d80f5f5a373_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX20XCS/2025-12-01/image/91491da4-8199-44f4-90b0-2d80f5f5a373_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7800d3dd-b271-56f9-9c1d-5a1b4b402c50
2025-12-01 19:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e605490>
2025-12-01 19:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91e3816c-1299-58c7-b5f9-71f70184e072/91e3816c-1299-58c7-b5f9-71f70184e072_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB66AVM%252F2025-12-01%252Fimage%252F3bad41e8-555c-4d01-9e08-c58d2065170f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB66AVM/2025-12-01/image/3bad41e8-555c-4d01-9e08-c58d2065170f_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 91e3816c-1299-58c7-b5f9-71f70184e072
2025-12-01 19:01:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117623725, 'registration': 'AO72WSU', 'account': 'KIN032', 'make': 'BMW', 'model': 'iX3 ELECTRIC ESTATE', 'derivative': '210kW M Sport 80kWh 5dr Auto', 'mileage': 15823, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 216}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-28', 'fuel': 'Electric', 'motExpiry': '2026-11-27', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/47765153-6e5e-4e87-ba92-fcae093ec2a8.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-01 19:01:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117623725, 'registration': 'AO72WSU', 'account': 'KIN032', 'make': 'BMW', 'model': 'iX3 ELECTRIC ESTATE', 'derivative': '210kW M Sport 80kWh 5dr Auto', 'mileage': 15823, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 216}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-28', 'fuel': 'Electric', 'motExpiry': '2026-11-27', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/47765153-6e5e-4e87-ba92-fcae093ec2a8.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-01 19:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39bcafb4-2ee3-5394-95e3-8fc20ce693f4 with identifier: 117623725
2025-12-01 19:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39bcafb4-2ee3-5394-95e3-8fc20ce693f4 with scrape type 1
2025-12-01 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 39bcafb4-2ee3-5394-95e3-8fc20ce693f4
2025-12-01 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 39bcafb4-2ee3-5394-95e3-8fc20ce693f4
2025-12-01 19:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 39bcafb4-2ee3-5394-95e3-8fc20ce693f4, identifier: 117623725
2025-12-01 19:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV22BSX/2025-12-01/image/f2f44ac0-22c4-4e06-a4b0-8b2318e1aa31_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117576078?view=catalogue)
2025-12-01 19:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/A2UOV/2025-09-18/image/ccc15175-e3bf-4e00-ad0d-132ada753d1f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/115422003?view=catalogue)
2025-12-01 19:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL67GVP/2025-12-01/image/2684b4b5-f27a-4ec5-9df2-78402a3ec932_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616437?view=catalogue)
2025-12-01 19:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB66AVM/2025-12-01/image/f917434e-1f34-4d80-9d4e-dc94bd53757e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117583759?view=catalogue)
2025-12-01 19:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX20XCS/2025-12-01/image/2299d1ed-3acf-4119-92ce-6411aefa8183_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549150?view=catalogue)
2025-12-01 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FA2UOV%252F2025-09-18%252Fimage%252Fb3ecb7cb-8fe0-4ff3-8538-4ab8db299eeb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/A2UOV/2025-09-18/image/b3ecb7cb-8fe0-4ff3-8538-4ab8db299eeb_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL67GVP%252F2025-12-01%252Fimage%252F24152e49-9701-4912-a2b1-265b5a8dd3b3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67GVP/2025-12-01/image/24152e49-9701-4912-a2b1-265b5a8dd3b3_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYB68EYD%252F2025-12-01%252Fimage%252F4b78d472-7505-4b14-8dd8-1ec9ccead57c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB68EYD/2025-12-01/image/4b78d472-7505-4b14-8dd8-1ec9ccead57c_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: eb4712bc-835e-5d1b-8a87-785ebf261f12 with identifier: 117002721
2025-12-01 19:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: eb4712bc-835e-5d1b-8a87-785ebf261f12 with identifier: 117002721
2025-12-01 19:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: eb4712bc-835e-5d1b-8a87-785ebf261f12 with identifier: 117002721 to the API
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/HT19ODX/2025-11-12/image/dc6660f0-875c-4fe8-becc-32ef9fe29749_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'eb4712bc-835e-5d1b-8a87-785ebf261f12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'HT19ODX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117002721',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'RENAULT',
 'model': 'KADJAR HATCHBACK',
 'odometer': 66282,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4712bc-835e-5d1b-8a87-785ebf261f12/eb4712bc-835e-5d1b-8a87-785ebf261f12_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38270,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/44964eec-e4aa-4b80-aa15-61f416130649_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4712bc-835e-5d1b-8a87-785ebf261f12/eb4712bc-835e-5d1b-8a87-785ebf261f12_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42133,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/40abfd10-cb75-42f7-a08d-b0ef032a35df_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4712bc-835e-5d1b-8a87-785ebf261f12/eb4712bc-835e-5d1b-8a87-785ebf261f12_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36776,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/dc6660f0-875c-4fe8-becc-32ef9fe29749_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4712bc-835e-5d1b-8a87-785ebf261f12/eb4712bc-835e-5d1b-8a87-785ebf261f12_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43286,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/26089d6e-ec0b-41a0-85ab-d873e2a7584c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4712bc-835e-5d1b-8a87-785ebf261f12/eb4712bc-835e-5d1b-8a87-785ebf261f12_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35889,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/b0bfd98c-9df5-4b2a-927c-aa46691d5bd1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4712bc-835e-5d1b-8a87-785ebf261f12/eb4712bc-835e-5d1b-8a87-785ebf261f12_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48188,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/38b4cbfe-c4e5-4158-b789-72352a9a5efb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4712bc-835e-5d1b-8a87-785ebf261f12/eb4712bc-835e-5d1b-8a87-785ebf261f12_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43388,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/7bc0a75e-3436-4b6c-a3e9-4a1537897680_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4712bc-835e-5d1b-8a87-785ebf261f12/eb4712bc-835e-5d1b-8a87-785ebf261f12_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46892,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/cdcc65c6-9647-4e07-af4b-4da74194aa5c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4712bc-835e-5d1b-8a87-785ebf261f12/eb4712bc-835e-5d1b-8a87-785ebf261f12_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36420,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/c8d6436d-822f-4390-91d8-ade87ccd6914_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-28',
 'seller_name': 'TCB Group - Value',
 'title': 'RENAULT KADJAR HATCHBACK 1.3 TCE Iconic 5dr',
 'transmission': 'manual',
 'trim': '1.3 TCE Iconic 5dr',
 'vin': None,
 'year': 2019}
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117002721%27 HTTP/1.1" 200 None
2025-12-01 19:01:27 [astonbarclay.gb] INFO: Saving data for 117002721: {'created_time': 1764615687.27575, 'last_price_update_time': 1764615687.275761, 'auction_closing_time': 1764756000.0}
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117002721') HTTP/1.1" 204 0
2025-12-01 19:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 39bcafb4-2ee3-5394-95e3-8fc20ce693f4 with identifier: 117623725
2025-12-01 19:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 39bcafb4-2ee3-5394-95e3-8fc20ce693f4 with identifier: 117623725
2025-12-01 19:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'bmw ix3 electric estate 210kw m sport 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'ix3 electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 15823, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-28', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117623725', 'expiration_date': '2025-12-09t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '210kw m sport 80kwh 5dr auto', 'license_plate': 'ao72wsu', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '39bcafb4-2ee3-5394-95e3-8fc20ce693f4', 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'bmw ix3 electric estate', 'sanitized_make': 'bmw', 'odometer_in_km': 25464} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-09t10:00:00z',
     'fuel_type': 'electric',
     'id': '39bcafb4-2ee3-5394-95e3-8fc20ce693f4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ao72wsu',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117623725',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'bmw',
     'make_model': 'bmw ix3 electric estate',
     'model': 'ix3 electric estate',
     'odometer': 15823,
     'odometer_in_km': 25464,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-28',
     'sanitized_make': 'bmw',
     'seller_name': 'kinto',
     'title': 'bmw ix3 electric estate 210kw m sport 80kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '210kw m sport 80kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-12-01 19:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 39bcafb4-2ee3-5394-95e3-8fc20ce693f4 spider: astonbarclay.gb
2025-12-01 19:01:27 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 39bcafb4-2ee3-5394-95e3-8fc20ce693f4 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'bmw ix3 electric estate 210kw m sport 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'ix3 electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 15823, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-28', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117623725', 'expiration_date': '2025-12-09t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '210kw m sport 80kwh 5dr auto', 'license_plate': 'ao72wsu', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '39bcafb4-2ee3-5394-95e3-8fc20ce693f4', 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'bmw ix3 electric estate', 'sanitized_make': 'bmw', 'odometer_in_km': 25464} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-09t10:00:00z',
     'fuel_type': 'electric',
     'id': '39bcafb4-2ee3-5394-95e3-8fc20ce693f4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ao72wsu',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117623725',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'bmw',
     'make_model': 'bmw ix3 electric estate',
     'model': 'ix3 electric estate',
     'odometer': 15823,
     'odometer_in_km': 25464,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-28',
     'sanitized_make': 'bmw',
     'seller_name': 'kinto',
     'title': 'bmw ix3 electric estate 210kw m sport 80kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '210kw m sport 80kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-09T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '39bcafb4-2ee3-5394-95e3-8fc20ce693f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'AO72WSU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117623725',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'BMW',
 'model': 'iX3 ELECTRIC ESTATE',
 'odometer': 15823,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-28',
 'seller_name': 'Kinto',
 'title': 'BMW iX3 ELECTRIC ESTATE 210kW M Sport 80kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '210kW M Sport 80kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117623725%27 HTTP/1.1" 200 None
2025-12-01 19:01:27 [astonbarclay.gb] INFO: Saving data for 117623725: {'created_time': 1764615687.485687, 'last_price_update_time': 1764615687.4857, 'auction_closing_time': 1765274400.0}
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117623725') HTTP/1.1" 204 0
2025-12-01 19:01:27 [astonbarclay.gb] INFO: Found listing with ID: 117585151
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585151%27 HTTP/1.1" 200 None
2025-12-01 19:01:27 [astonbarclay.gb] INFO: Scrape type for 117585151: 0
2025-12-01 19:01:27 [astonbarclay.gb] INFO: Found listing with ID: 117585166
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585166%27 HTTP/1.1" 200 None
2025-12-01 19:01:27 [astonbarclay.gb] INFO: Scrape type for 117585166: 0
2025-12-01 19:01:27 [astonbarclay.gb] INFO: Found listing with ID: 117585083
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585083%27 HTTP/1.1" 200 None
2025-12-01 19:01:27 [astonbarclay.gb] INFO: Scrape type for 117585083: 0
2025-12-01 19:01:27 [astonbarclay.gb] INFO: Found listing with ID: 117585141
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585141%27 HTTP/1.1" 200 None
2025-12-01 19:01:27 [astonbarclay.gb] INFO: Scrape type for 117585141: 0
2025-12-01 19:01:27 [astonbarclay.gb] INFO: Found listing with ID: 117585190
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585190%27 HTTP/1.1" 200 None
2025-12-01 19:01:27 [astonbarclay.gb] INFO: Scrape type for 117585190: 0
2025-12-01 19:01:27 [astonbarclay.gb] INFO: Found listing with ID: 117585347
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585347%27 HTTP/1.1" 200 None
2025-12-01 19:01:27 [astonbarclay.gb] INFO: Scrape type for 117585347: 0
2025-12-01 19:01:27 [astonbarclay.gb] INFO: Found listing with ID: 117585132
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585132%27 HTTP/1.1" 200 None
2025-12-01 19:01:27 [astonbarclay.gb] INFO: Scrape type for 117585132: 0
2025-12-01 19:01:27 [astonbarclay.gb] INFO: Found listing with ID: 117627838
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117627838%27 HTTP/1.1" 200 None
2025-12-01 19:01:27 [astonbarclay.gb] INFO: Scrape type for 117627838: 1
2025-12-01 19:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e69b910>
2025-12-01 19:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49ea86bd-0188-543f-9dff-87dbf2d122aa/49ea86bd-0188-543f-9dff-87dbf2d122aa_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV22BSX%252F2025-12-01%252Fimage%252F121f1a1c-cae5-4087-8b77-142d917a6b27_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV22BSX/2025-12-01/image/121f1a1c-cae5-4087-8b77-142d917a6b27_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 49ea86bd-0188-543f-9dff-87dbf2d122aa
2025-12-01 19:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL67GVP/2025-12-01/image/0deb3815-cf8a-42c5-b69b-200686c56332_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616437?view=catalogue)
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FA2UOV%252F2025-09-18%252Fimage%252Ffe6a0c77-4db4-447f-af9e-89669cd126ea_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/A2UOV/2025-09-18/image/fe6a0c77-4db4-447f-af9e-89669cd126ea_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL67GVP%252F2025-12-01%252Fimage%252Fc7ddf0f7-ff4e-4390-bf5e-0538de35b916_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67GVP/2025-12-01/image/c7ddf0f7-ff4e-4390-bf5e-0538de35b916_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYB68EYD%252F2025-12-01%252Fimage%252F34e8c971-ed9e-4274-91ea-4acba1b07b35_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB68EYD/2025-12-01/image/34e8c971-ed9e-4274-91ea-4acba1b07b35_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e683e50>
2025-12-01 19:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91e3816c-1299-58c7-b5f9-71f70184e072/91e3816c-1299-58c7-b5f9-71f70184e072_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB66AVM%252F2025-12-01%252Fimage%252F09dd2531-a177-4090-b146-39b989553254_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB66AVM/2025-12-01/image/09dd2531-a177-4090-b146-39b989553254_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 91e3816c-1299-58c7-b5f9-71f70184e072
2025-12-01 19:01:28 [astonbarclay.gb] INFO: Found listing with ID: 60238390
2025-12-01 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2760238390%27 HTTP/1.1" 200 None
2025-12-01 19:01:28 [astonbarclay.gb] INFO: Scrape type for 60238390: 1
2025-12-01 19:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e694cd0>
2025-12-01 19:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49ea86bd-0188-543f-9dff-87dbf2d122aa/49ea86bd-0188-543f-9dff-87dbf2d122aa_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV22BSX%252F2025-12-01%252Fimage%252Ff2f44ac0-22c4-4e06-a4b0-8b2318e1aa31_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV22BSX/2025-12-01/image/f2f44ac0-22c4-4e06-a4b0-8b2318e1aa31_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 49ea86bd-0188-543f-9dff-87dbf2d122aa
2025-12-01 19:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e694cd0>
2025-12-01 19:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e8ecdcf-db96-5832-a676-c26fb5f17208/5e8ecdcf-db96-5832-a676-c26fb5f17208_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FA2UOV%252F2025-09-18%252Fimage%252Fccc15175-e3bf-4e00-ad0d-132ada753d1f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/A2UOV/2025-09-18/image/ccc15175-e3bf-4e00-ad0d-132ada753d1f_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5e8ecdcf-db96-5832-a676-c26fb5f17208
2025-12-01 19:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6c0390>
2025-12-01 19:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac69f87-d87d-50d2-929c-94d0a460224e/3ac69f87-d87d-50d2-929c-94d0a460224e_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL67GVP%252F2025-12-01%252Fimage%252F2684b4b5-f27a-4ec5-9df2-78402a3ec932_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67GVP/2025-12-01/image/2684b4b5-f27a-4ec5-9df2-78402a3ec932_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ac69f87-d87d-50d2-929c-94d0a460224e
2025-12-01 19:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e52a710>
2025-12-01 19:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91e3816c-1299-58c7-b5f9-71f70184e072/91e3816c-1299-58c7-b5f9-71f70184e072_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB66AVM%252F2025-12-01%252Fimage%252Ff917434e-1f34-4d80-9d4e-dc94bd53757e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB66AVM/2025-12-01/image/f917434e-1f34-4d80-9d4e-dc94bd53757e_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 91e3816c-1299-58c7-b5f9-71f70184e072
2025-12-01 19:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e9beb90>
2025-12-01 19:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7800d3dd-b271-56f9-9c1d-5a1b4b402c50/7800d3dd-b271-56f9-9c1d-5a1b4b402c50_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX20XCS%252F2025-12-01%252Fimage%252F2299d1ed-3acf-4119-92ce-6411aefa8183_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX20XCS/2025-12-01/image/2299d1ed-3acf-4119-92ce-6411aefa8183_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7800d3dd-b271-56f9-9c1d-5a1b4b402c50
2025-12-01 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YB68EYD/2025-12-01/image/a73aeae7-0f3a-4387-ba2f-033e0e192672_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117622575?view=catalogue)
2025-12-01 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/A2UOV/2025-09-18/image/193d37ce-cb43-472e-9ffc-c01f047e2690_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/115422003?view=catalogue)
2025-12-01 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/A2UOV/2025-09-18/image/32485ed9-e7a8-4072-8dd0-6aa655fc8b2c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/115422003?view=catalogue)
2025-12-01 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL67GVP/2025-12-01/image/64bca94c-3a14-464b-8eee-169f63b687bb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616437?view=catalogue)
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FA2UOV%252F2025-09-18%252Fimage%252Fae94a4ee-997e-45e6-8277-7da0a0643237_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/A2UOV/2025-09-18/image/ae94a4ee-997e-45e6-8277-7da0a0643237_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL67GVP%252F2025-12-01%252Fimage%252Ff034c8a2-dc84-4397-8de2-3604b84f9cb7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67GVP/2025-12-01/image/f034c8a2-dc84-4397-8de2-3604b84f9cb7_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYB68EYD%252F2025-12-01%252Fimage%252Fe8d6d2cf-97a5-4f7f-814b-fae6ce538cd3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB68EYD/2025-12-01/image/e8d6d2cf-97a5-4f7f-814b-fae6ce538cd3_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:29 [astonbarclay.gb] INFO: Found listing with ID: 117366549
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117366549%27 HTTP/1.1" 200 None
2025-12-01 19:01:29 [astonbarclay.gb] INFO: Scrape type for 117366549: 1
2025-12-01 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117571526?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117547841?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f50647c0a90>
2025-12-01 19:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac69f87-d87d-50d2-929c-94d0a460224e/3ac69f87-d87d-50d2-929c-94d0a460224e_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL67GVP%252F2025-12-01%252Fimage%252F0deb3815-cf8a-42c5-b69b-200686c56332_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67GVP/2025-12-01/image/0deb3815-cf8a-42c5-b69b-200686c56332_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ac69f87-d87d-50d2-929c-94d0a460224e
2025-12-01 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YB68EYD/2025-12-01/image/4b78d472-7505-4b14-8dd8-1ec9ccead57c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117622575?view=catalogue)
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FA2UOV%252F2025-09-18%252Fimage%252Fbf982db3-14dc-4ccf-9a01-8e41be32c5d8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/A2UOV/2025-09-18/image/bf982db3-14dc-4ccf-9a01-8e41be32c5d8_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL67GVP%252F2025-12-01%252Fimage%252F8a6483b1-8822-4cfc-8b04-db179dc22998_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67GVP/2025-12-01/image/8a6483b1-8822-4cfc-8b04-db179dc22998_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYB68EYD%252F2025-12-01%252Fimage%252Fb3d45017-8f2c-4c9d-b363-e07e5be30477_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB68EYD/2025-12-01/image/b3d45017-8f2c-4c9d-b363-e07e5be30477_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116997754?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117442253?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117099385?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117599947
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599947%27 HTTP/1.1" 200 None
2025-12-01 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117599947: 0
2025-12-01 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117599932
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599932%27 HTTP/1.1" 200 None
2025-12-01 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117599932: 0
2025-12-01 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 116288981
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116288981%27 HTTP/1.1" 200 None
2025-12-01 19:01:30 [astonbarclay.gb] INFO: Scrape type for 116288981: 1
2025-12-01 19:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YB68EYD/2025-12-01/image/34e8c971-ed9e-4274-91ea-4acba1b07b35_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117622575?view=catalogue)
2025-12-01 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/A2UOV/2025-09-18/image/fe6a0c77-4db4-447f-af9e-89669cd126ea_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/115422003?view=catalogue)
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL67GVP%252F2025-12-01%252Fimage%252F16a89b3c-cd63-487f-af12-84b1a3d22f93_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67GVP/2025-12-01/image/16a89b3c-cd63-487f-af12-84b1a3d22f93_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYB68EYD%252F2025-12-01%252Fimage%252F2ef2c559-4b24-4bd4-9ed4-aa86d937a430_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB68EYD/2025-12-01/image/2ef2c559-4b24-4bd4-9ed4-aa86d937a430_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6b77d0>
2025-12-01 19:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b55ecf4d-4b7d-502e-8147-27eca949960d/b55ecf4d-4b7d-502e-8147-27eca949960d_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYB68EYD%252F2025-12-01%252Fimage%252Fa73aeae7-0f3a-4387-ba2f-033e0e192672_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB68EYD/2025-12-01/image/a73aeae7-0f3a-4387-ba2f-033e0e192672_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b55ecf4d-4b7d-502e-8147-27eca949960d
2025-12-01 19:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e53b1d0>
2025-12-01 19:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e8ecdcf-db96-5832-a676-c26fb5f17208/5e8ecdcf-db96-5832-a676-c26fb5f17208_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FA2UOV%252F2025-09-18%252Fimage%252F193d37ce-cb43-472e-9ffc-c01f047e2690_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/A2UOV/2025-09-18/image/193d37ce-cb43-472e-9ffc-c01f047e2690_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5e8ecdcf-db96-5832-a676-c26fb5f17208
2025-12-01 19:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e9cffd0>
2025-12-01 19:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e8ecdcf-db96-5832-a676-c26fb5f17208/5e8ecdcf-db96-5832-a676-c26fb5f17208_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FA2UOV%252F2025-09-18%252Fimage%252F32485ed9-e7a8-4072-8dd0-6aa655fc8b2c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/A2UOV/2025-09-18/image/32485ed9-e7a8-4072-8dd0-6aa655fc8b2c_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5e8ecdcf-db96-5832-a676-c26fb5f17208
2025-12-01 19:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6588d0>
2025-12-01 19:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac69f87-d87d-50d2-929c-94d0a460224e/3ac69f87-d87d-50d2-929c-94d0a460224e_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL67GVP%252F2025-12-01%252Fimage%252F64bca94c-3a14-464b-8eee-169f63b687bb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67GVP/2025-12-01/image/64bca94c-3a14-464b-8eee-169f63b687bb_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ac69f87-d87d-50d2-929c-94d0a460224e
2025-12-01 19:01:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117571526, 'registration': 'DW19ZVN', 'account': 'GAT003', 'make': 'VAUXHALL', 'model': 'CROSSLAND X HATCHBACK', 'derivative': '1.2T [130] Elite 5dr [Start Stop]', 'mileage': 49828, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 149}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-06-25', 'fuel': 'Petrol', 'motExpiry': '2026-02-01', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa @ 20k 32k 42k 46k', 'virtual': False, 'seller': 'Gateway Peugeot', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 116, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117571526, 'registration': 'DW19ZVN', 'account': 'GAT003', 'make': 'VAUXHALL', 'model': 'CROSSLAND X HATCHBACK', 'derivative': '1.2T [130] Elite 5dr [Start Stop]', 'mileage': 49828, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 149}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-06-25', 'fuel': 'Petrol', 'motExpiry': '2026-02-01', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa @ 20k 32k 42k 46k', 'virtual': False, 'seller': 'Gateway Peugeot', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 116, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dade69f-058b-522a-9eff-ddb0cfd5df46 with identifier: 117571526
2025-12-01 19:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dade69f-058b-522a-9eff-ddb0cfd5df46 with scrape type 1
2025-12-01 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 1dade69f-058b-522a-9eff-ddb0cfd5df46
2025-12-01 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 1dade69f-058b-522a-9eff-ddb0cfd5df46
2025-12-01 19:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1dade69f-058b-522a-9eff-ddb0cfd5df46, identifier: 117571526
2025-12-01 19:01:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117547841, 'registration': 'SK22HVM', 'account': 'THE109', 'make': 'TOYOTA', 'model': 'YARIS CROSS ESTATE', 'derivative': '1.5 Hybrid Icon 5dr CVT', 'mileage': 40670, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-04-15', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-04-14', 'doors': 5, 'engineSize': 1490, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 32K,', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 100, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117547841, 'registration': 'SK22HVM', 'account': 'THE109', 'make': 'TOYOTA', 'model': 'YARIS CROSS ESTATE', 'derivative': '1.5 Hybrid Icon 5dr CVT', 'mileage': 40670, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-04-15', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-04-14', 'doors': 5, 'engineSize': 1490, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 32K,', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 100, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a61f1e95-7271-58d2-b5a7-8f6c433dd560 with identifier: 117547841
2025-12-01 19:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a61f1e95-7271-58d2-b5a7-8f6c433dd560 with scrape type 1
2025-12-01 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item a61f1e95-7271-58d2-b5a7-8f6c433dd560
2025-12-01 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item a61f1e95-7271-58d2-b5a7-8f6c433dd560
2025-12-01 19:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a61f1e95-7271-58d2-b5a7-8f6c433dd560, identifier: 117547841
2025-12-01 19:01:31 [astonbarclay.gb] INFO: Found listing with ID: 117600700
2025-12-01 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600700%27 HTTP/1.1" 200 None
2025-12-01 19:01:31 [astonbarclay.gb] INFO: Scrape type for 117600700: 0
2025-12-01 19:01:31 [astonbarclay.gb] INFO: Found listing with ID: 116896181
2025-12-01 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116896181%27 HTTP/1.1" 200 None
2025-12-01 19:01:31 [astonbarclay.gb] INFO: Scrape type for 116896181: 1
2025-12-01 19:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1dade69f-058b-522a-9eff-ddb0cfd5df46 with identifier: 117571526
2025-12-01 19:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1dade69f-058b-522a-9eff-ddb0cfd5df46 with identifier: 117571526
2025-12-01 19:01:31 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1dade69f-058b-522a-9eff-ddb0cfd5df46 with identifier: 117571526 to the API
2025-12-01 19:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:01:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%271dade69f-058b-522a-9eff-ddb0cfd5df46%27 HTTP/1.1" 200 None
2025-12-01 19:01:32 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 1dade69f-058b-522a-9eff-ddb0cfd5df46: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:01:31 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117571526?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '1dade69f-058b-522a-9eff-ddb0cfd5df46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DW19ZVN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117571526',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VAUXHALL',
 'model': 'CROSSLAND X HATCHBACK',
 'odometer': 49828,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-25',
 'seller_name': 'Gateway Peugeot',
 'title': 'VAUXHALL CROSSLAND X HATCHBACK 1.2T [130] Elite 5dr [Start Stop]',
 'transmission': 'manual',
 'trim': '1.2T [130] Elite 5dr [Start Stop]',
 'vin': None,
 'year': 2019}
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117571526%27 HTTP/1.1" 200 None
2025-12-01 19:01:32 [astonbarclay.gb] INFO: Saving data for 117571526: {'created_time': 1764615692.029024, 'last_price_update_time': 1764615692.029036, 'auction_closing_time': 1764842400.0}
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117571526') HTTP/1.1" 204 0
2025-12-01 19:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a61f1e95-7271-58d2-b5a7-8f6c433dd560 with identifier: 117547841
2025-12-01 19:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a61f1e95-7271-58d2-b5a7-8f6c433dd560 with identifier: 117547841
2025-12-01 19:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a61f1e95-7271-58d2-b5a7-8f6c433dd560 with identifier: 117547841 to the API
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27a61f1e95-7271-58d2-b5a7-8f6c433dd560%27 HTTP/1.1" 200 None
2025-12-01 19:01:32 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id a61f1e95-7271-58d2-b5a7-8f6c433dd560: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:01:31 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117547841?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'a61f1e95-7271-58d2-b5a7-8f6c433dd560',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SK22HVM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117547841',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'TOYOTA',
 'model': 'YARIS CROSS ESTATE',
 'odometer': 40670,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-15',
 'seller_name': 'TCB Group - Prime',
 'title': 'TOYOTA YARIS CROSS ESTATE 1.5 Hybrid Icon 5dr CVT',
 'transmission': 'automatic',
 'trim': '1.5 Hybrid Icon 5dr CVT',
 'vin': None,
 'year': 2022}
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547841%27 HTTP/1.1" 200 None
2025-12-01 19:01:32 [astonbarclay.gb] INFO: Saving data for 117547841: {'created_time': 1764615692.401869, 'last_price_update_time': 1764615692.40188, 'auction_closing_time': 1764927900.0}
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117547841') HTTP/1.1" 204 0
2025-12-01 19:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/A2UOV/2025-09-18/image/ae94a4ee-997e-45e6-8277-7da0a0643237_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/115422003?view=catalogue)
2025-12-01 19:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YB68EYD/2025-12-01/image/e8d6d2cf-97a5-4f7f-814b-fae6ce538cd3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117622575?view=catalogue)
2025-12-01 19:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL67GVP/2025-12-01/image/c7ddf0f7-ff4e-4390-bf5e-0538de35b916_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616437?view=catalogue)
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLL67GVP%252F2025-12-01%252Fimage%252F9a25b8d0-6ad5-4202-b9b0-619877fe6421_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67GVP/2025-12-01/image/9a25b8d0-6ad5-4202-b9b0-619877fe6421_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYB68EYD%252F2025-12-01%252Fimage%252Fbf073061-5882-496e-a357-cb101bf98c61_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB68EYD/2025-12-01/image/bf073061-5882-496e-a357-cb101bf98c61_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL67GVP/2025-12-01/image/24152e49-9701-4912-a2b1-265b5a8dd3b3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616437?view=catalogue)
2025-12-01 19:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL67GVP/2025-12-01/image/f034c8a2-dc84-4397-8de2-3604b84f9cb7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616437?view=catalogue)
2025-12-01 19:01:32 [astonbarclay.gb] INFO: Found listing with ID: 117547822
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547822%27 HTTP/1.1" 200 None
2025-12-01 19:01:32 [astonbarclay.gb] INFO: Scrape type for 117547822: 1
2025-12-01 19:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117548617?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117638131?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e694210>
2025-12-01 19:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b55ecf4d-4b7d-502e-8147-27eca949960d/b55ecf4d-4b7d-502e-8147-27eca949960d_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYB68EYD%252F2025-12-01%252Fimage%252F4b78d472-7505-4b14-8dd8-1ec9ccead57c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB68EYD/2025-12-01/image/4b78d472-7505-4b14-8dd8-1ec9ccead57c_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b55ecf4d-4b7d-502e-8147-27eca949960d
2025-12-01 19:01:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116997754, 'registration': 'PMN202V', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'CAPTUR HATCHBACK', 'derivative': '1.3 TCE 140 Iconic Edition 5dr', 'mileage': 32634, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 149}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2022-04-19', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PMN202V/2025-11-06/image/f97d2254-1b9f-4735-a8ee-c695253d65f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/1e4e2a67-6936-45b0-a38f-82b2eaf5e37a_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/8ea2c304-2809-49ac-9e6a-855eb478d2e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/519d201f-a070-4799-bd55-5138dac9854e_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/c1878dca-49cf-4c27-84b6-6563db073c4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/2d168458-ec89-4e83-9133-176e41a70955_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/f5ad9c39-1cc5-491c-b845-ab2e80e9b6f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/f977f8b0-f990-496a-8c97-91797d37ffc6_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/d7bb92e4-8f27-4797-a918-51ff41be9dd3_removebg.jpg?w=600'], 'colour': None, 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 03/23- 8k, 03/24- 17k, 03/25-26k', 'remarks': 'spare key in office IOM Certificate This vehicle must be registered onto UK plates before use on a public highway". IOM V5 Present,', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9c1d835e-e55c-4494-959f-41b96dcf72ef.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': None, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116997754, 'registration': 'PMN202V', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'CAPTUR HATCHBACK', 'derivative': '1.3 TCE 140 Iconic Edition 5dr', 'mileage': 32634, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 149}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2022-04-19', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PMN202V/2025-11-06/image/f97d2254-1b9f-4735-a8ee-c695253d65f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/1e4e2a67-6936-45b0-a38f-82b2eaf5e37a_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/8ea2c304-2809-49ac-9e6a-855eb478d2e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/519d201f-a070-4799-bd55-5138dac9854e_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/c1878dca-49cf-4c27-84b6-6563db073c4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/2d168458-ec89-4e83-9133-176e41a70955_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/f5ad9c39-1cc5-491c-b845-ab2e80e9b6f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/f977f8b0-f990-496a-8c97-91797d37ffc6_removebg.jpg?w=600', 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/d7bb92e4-8f27-4797-a918-51ff41be9dd3_removebg.jpg?w=600'], 'colour': None, 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 03/23- 8k, 03/24- 17k, 03/25-26k', 'remarks': 'spare key in office IOM Certificate This vehicle must be registered onto UK plates before use on a public highway". IOM V5 Present,', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9c1d835e-e55c-4494-959f-41b96dcf72ef.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': None, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 498a6fee-1e22-5c90-919f-b3db8c1a1fee with identifier: 116997754
2025-12-01 19:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 498a6fee-1e22-5c90-919f-b3db8c1a1fee with scrape type 1
2025-12-01 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 498a6fee-1e22-5c90-919f-b3db8c1a1fee
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPMN202V%252F2025-11-06%252Fimage%252Ff97d2254-1b9f-4735-a8ee-c695253d65f3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PMN202V/2025-11-06/image/f97d2254-1b9f-4735-a8ee-c695253d65f3_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117442253, 'registration': 'RV72YYL', 'account': 'DAY005', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 26266, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-09-09', 'fuel': 'Diesel', 'motExpiry': '2026-09-08', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 24K,', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-01 19:01:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117442253, 'registration': 'RV72YYL', 'account': 'DAY005', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 26266, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-09-09', 'fuel': 'Diesel', 'motExpiry': '2026-09-08', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 24K,', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-01 19:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20ce7ea9-061c-5609-b3b6-0e974d7e3938 with identifier: 117442253
2025-12-01 19:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20ce7ea9-061c-5609-b3b6-0e974d7e3938 with scrape type 1
2025-12-01 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 20ce7ea9-061c-5609-b3b6-0e974d7e3938
2025-12-01 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 20ce7ea9-061c-5609-b3b6-0e974d7e3938
2025-12-01 19:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 20ce7ea9-061c-5609-b3b6-0e974d7e3938, identifier: 117442253
2025-12-01 19:01:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117099385, 'registration': 'NMN170X', 'account': 'MOT070', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A180 Sport 5dr', 'mileage': 24960, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 149}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-11-12', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NMN170X/2025-11-11/image/cc4aa83c-ec05-4c40-b921-5acf5a4d607e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/d25140bf-37eb-452a-8d00-218d72db8d72_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/1d5bc75a-2ae4-42c1-aa24-990f771ada9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/024c4b16-7aa6-4e47-8df8-be8725f063f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/ac81bfcd-8c79-4074-bf0b-4c6326c92761_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/45ced919-696c-4e83-88ba-f21bb72ca49a_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/ba0ea8d0-8420-479f-9ce9-c7383af8f69c_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/b4dd87c0-4f27-4d5f-830d-54edde2109fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/59610efb-1fa3-4ff1-a171-2348499bc6e1_removebg.jpg?w=600'], 'colour': None, 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 02/21- 5k, 02/22- 9k, 04/23- 13k, 07/24- 18k', 'remarks': 'spare key IOM Certificate This vehicle must be registered onto UK plates before use on a public highway". IOM V5 Present,', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0ca0638b-47ba-400c-aa65-4128d944098e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': None, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117099385, 'registration': 'NMN170X', 'account': 'MOT070', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A180 Sport 5dr', 'mileage': 24960, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 149}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-11-12', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NMN170X/2025-11-11/image/cc4aa83c-ec05-4c40-b921-5acf5a4d607e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/d25140bf-37eb-452a-8d00-218d72db8d72_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/1d5bc75a-2ae4-42c1-aa24-990f771ada9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/024c4b16-7aa6-4e47-8df8-be8725f063f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/ac81bfcd-8c79-4074-bf0b-4c6326c92761_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/45ced919-696c-4e83-88ba-f21bb72ca49a_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/ba0ea8d0-8420-479f-9ce9-c7383af8f69c_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/b4dd87c0-4f27-4d5f-830d-54edde2109fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/59610efb-1fa3-4ff1-a171-2348499bc6e1_removebg.jpg?w=600'], 'colour': None, 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 02/21- 5k, 02/22- 9k, 04/23- 13k, 07/24- 18k', 'remarks': 'spare key IOM Certificate This vehicle must be registered onto UK plates before use on a public highway". IOM V5 Present,', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0ca0638b-47ba-400c-aa65-4128d944098e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': None, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: affd00f4-2832-5372-b512-dce5abdf7275 with identifier: 117099385
2025-12-01 19:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item affd00f4-2832-5372-b512-dce5abdf7275 with scrape type 1
2025-12-01 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item affd00f4-2832-5372-b512-dce5abdf7275
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNMN170X%252F2025-11-11%252Fimage%252Fcc4aa83c-ec05-4c40-b921-5acf5a4d607e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NMN170X/2025-11-11/image/cc4aa83c-ec05-4c40-b921-5acf5a4d607e_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e88ce10>
2025-12-01 19:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b55ecf4d-4b7d-502e-8147-27eca949960d/b55ecf4d-4b7d-502e-8147-27eca949960d_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYB68EYD%252F2025-12-01%252Fimage%252F34e8c971-ed9e-4274-91ea-4acba1b07b35_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB68EYD/2025-12-01/image/34e8c971-ed9e-4274-91ea-4acba1b07b35_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b55ecf4d-4b7d-502e-8147-27eca949960d
2025-12-01 19:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e9a07d0>
2025-12-01 19:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e8ecdcf-db96-5832-a676-c26fb5f17208/5e8ecdcf-db96-5832-a676-c26fb5f17208_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FA2UOV%252F2025-09-18%252Fimage%252Ffe6a0c77-4db4-447f-af9e-89669cd126ea_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/A2UOV/2025-09-18/image/fe6a0c77-4db4-447f-af9e-89669cd126ea_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5e8ecdcf-db96-5832-a676-c26fb5f17208
2025-12-01 19:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YB68EYD/2025-12-01/image/b3d45017-8f2c-4c9d-b363-e07e5be30477_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117622575?view=catalogue)
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYB68EYD%252F2025-12-01%252Fimage%252Fb80b57ff-f17c-4d88-bf34-bcee8192199a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB68EYD/2025-12-01/image/b80b57ff-f17c-4d88-bf34-bcee8192199a_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117631028?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 20ce7ea9-061c-5609-b3b6-0e974d7e3938 with identifier: 117442253
2025-12-01 19:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 20ce7ea9-061c-5609-b3b6-0e974d7e3938 with identifier: 117442253
2025-12-01 19:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 20ce7ea9-061c-5609-b3b6-0e974d7e3938 with identifier: 117442253 to the API
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2720ce7ea9-061c-5609-b3b6-0e974d7e3938%27 HTTP/1.1" 200 None
2025-12-01 19:01:33 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 20ce7ea9-061c-5609-b3b6-0e974d7e3938: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:01:32 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117442253?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '20ce7ea9-061c-5609-b3b6-0e974d7e3938',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'RV72YYL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117442253',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF DIESEL HATCHBACK',
 'odometer': 26266,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-09',
 'seller_name': 'Days Fleet',
 'title': 'VOLKSWAGEN GOLF DIESEL HATCHBACK 2.0 TDI Life 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI Life 5dr',
 'vin': None,
 'year': 2022}
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117442253%27 HTTP/1.1" 200 None
2025-12-01 19:01:33 [astonbarclay.gb] INFO: Saving data for 117442253: {'created_time': 1764615693.772266, 'last_price_update_time': 1764615693.772277, 'auction_closing_time': 1764927900.0}
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117442253') HTTP/1.1" 204 0
2025-12-01 19:01:33 [astonbarclay.gb] INFO: Found listing with ID: 117578188
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117578188%27 HTTP/1.1" 200 None
2025-12-01 19:01:33 [astonbarclay.gb] INFO: Scrape type for 117578188: 1
2025-12-01 19:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPMN202V%252F2025-11-06%252Fimage%252F1e4e2a67-6936-45b0-a38f-82b2eaf5e37a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PMN202V/2025-11-06/image/1e4e2a67-6936-45b0-a38f-82b2eaf5e37a_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNMN170X%252F2025-11-11%252Fimage%252Fd25140bf-37eb-452a-8d00-218d72db8d72_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NMN170X/2025-11-11/image/d25140bf-37eb-452a-8d00-218d72db8d72_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YB68EYD/2025-12-01/image/2ef2c559-4b24-4bd4-9ed4-aa86d937a430_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117622575?view=catalogue)
2025-12-01 19:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL67GVP/2025-12-01/image/16a89b3c-cd63-487f-af12-84b1a3d22f93_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616437?view=catalogue)
2025-12-01 19:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL67GVP/2025-12-01/image/8a6483b1-8822-4cfc-8b04-db179dc22998_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616437?view=catalogue)
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYB68EYD%252F2025-12-01%252Fimage%252Fabd0c03b-e3a4-43a5-881a-fdf2ef75970a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB68EYD/2025-12-01/image/abd0c03b-e3a4-43a5-881a-fdf2ef75970a_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e643590>
2025-12-01 19:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e8ecdcf-db96-5832-a676-c26fb5f17208/5e8ecdcf-db96-5832-a676-c26fb5f17208_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FA2UOV%252F2025-09-18%252Fimage%252Fae94a4ee-997e-45e6-8277-7da0a0643237_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/A2UOV/2025-09-18/image/ae94a4ee-997e-45e6-8277-7da0a0643237_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5e8ecdcf-db96-5832-a676-c26fb5f17208
2025-12-01 19:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6229d0>
2025-12-01 19:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b55ecf4d-4b7d-502e-8147-27eca949960d/b55ecf4d-4b7d-502e-8147-27eca949960d_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYB68EYD%252F2025-12-01%252Fimage%252Fe8d6d2cf-97a5-4f7f-814b-fae6ce538cd3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB68EYD/2025-12-01/image/e8d6d2cf-97a5-4f7f-814b-fae6ce538cd3_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b55ecf4d-4b7d-502e-8147-27eca949960d
2025-12-01 19:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e7e6250>
2025-12-01 19:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac69f87-d87d-50d2-929c-94d0a460224e/3ac69f87-d87d-50d2-929c-94d0a460224e_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL67GVP%252F2025-12-01%252Fimage%252Fc7ddf0f7-ff4e-4390-bf5e-0538de35b916_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67GVP/2025-12-01/image/c7ddf0f7-ff4e-4390-bf5e-0538de35b916_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ac69f87-d87d-50d2-929c-94d0a460224e
2025-12-01 19:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6a9550>
2025-12-01 19:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac69f87-d87d-50d2-929c-94d0a460224e/3ac69f87-d87d-50d2-929c-94d0a460224e_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL67GVP%252F2025-12-01%252Fimage%252F24152e49-9701-4912-a2b1-265b5a8dd3b3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67GVP/2025-12-01/image/24152e49-9701-4912-a2b1-265b5a8dd3b3_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ac69f87-d87d-50d2-929c-94d0a460224e
2025-12-01 19:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e76c5d0>
2025-12-01 19:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac69f87-d87d-50d2-929c-94d0a460224e/3ac69f87-d87d-50d2-929c-94d0a460224e_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL67GVP%252F2025-12-01%252Fimage%252Ff034c8a2-dc84-4397-8de2-3604b84f9cb7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67GVP/2025-12-01/image/f034c8a2-dc84-4397-8de2-3604b84f9cb7_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3ac69f87-d87d-50d2-929c-94d0a460224e
2025-12-01 19:01:35 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117548617, 'registration': 'DF23VHW', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 41176, 'mileageWarranty': False, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-07-24', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '**1840** SPARE KEY', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-01 19:01:35 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117548617, 'registration': 'DF23VHW', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 41176, 'mileageWarranty': False, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-05T09:45Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-07-24', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '**1840** SPARE KEY', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-01 19:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84cf3344-bd7b-532c-932d-f1a9fc1fc3e0 with identifier: 117548617
2025-12-01 19:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84cf3344-bd7b-532c-932d-f1a9fc1fc3e0 with scrape type 1
2025-12-01 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 84cf3344-bd7b-532c-932d-f1a9fc1fc3e0
2025-12-01 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 84cf3344-bd7b-532c-932d-f1a9fc1fc3e0
2025-12-01 19:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 84cf3344-bd7b-532c-932d-f1a9fc1fc3e0, identifier: 117548617
2025-12-01 19:01:35 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117638131, 'registration': 'MD74ZCX', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'SCENIC E-TECH ELECTRIC ESTATE', 'derivative': '160kW Esprit Alpine 87kWh Long Range 5dr Auto', 'mileage': 15869, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 149}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2024-12-23', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:35 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117638131, 'registration': 'MD74ZCX', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'SCENIC E-TECH ELECTRIC ESTATE', 'derivative': '160kW Esprit Alpine 87kWh Long Range 5dr Auto', 'mileage': 15869, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 149}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2024-12-23', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': None, 'colour': 'GREY/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac0a4f7c-5d1c-59ed-a946-6f8e53df1fcd with identifier: 117638131
2025-12-01 19:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac0a4f7c-5d1c-59ed-a946-6f8e53df1fcd with scrape type 1
2025-12-01 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item ac0a4f7c-5d1c-59ed-a946-6f8e53df1fcd
2025-12-01 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item ac0a4f7c-5d1c-59ed-a946-6f8e53df1fcd
2025-12-01 19:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ac0a4f7c-5d1c-59ed-a946-6f8e53df1fcd, identifier: 117638131
2025-12-01 19:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/A2UOV/2025-09-18/image/bf982db3-14dc-4ccf-9a01-8e41be32c5d8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/115422003?view=catalogue)
2025-12-01 19:01:35 [astonbarclay.gb] INFO: Found listing with ID: 117585035
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585035%27 HTTP/1.1" 200 None
2025-12-01 19:01:35 [astonbarclay.gb] INFO: Scrape type for 117585035: 0
2025-12-01 19:01:35 [astonbarclay.gb] INFO: Found listing with ID: 117600202
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600202%27 HTTP/1.1" 200 None
2025-12-01 19:01:35 [astonbarclay.gb] INFO: Scrape type for 117600202: 0
2025-12-01 19:01:35 [astonbarclay.gb] INFO: Found listing with ID: 117604347
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117604347%27 HTTP/1.1" 200 None
2025-12-01 19:01:35 [astonbarclay.gb] INFO: Scrape type for 117604347: 0
2025-12-01 19:01:35 [astonbarclay.gb] INFO: Found listing with ID: 117604369
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117604369%27 HTTP/1.1" 200 None
2025-12-01 19:01:35 [astonbarclay.gb] INFO: Scrape type for 117604369: 0
2025-12-01 19:01:35 [astonbarclay.gb] INFO: Found listing with ID: 117616509
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117616509%27 HTTP/1.1" 200 None
2025-12-01 19:01:35 [astonbarclay.gb] INFO: Scrape type for 117616509: 1
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPMN202V%252F2025-11-06%252Fimage%252F8ea2c304-2809-49ac-9e6a-855eb478d2e6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PMN202V/2025-11-06/image/8ea2c304-2809-49ac-9e6a-855eb478d2e6_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNMN170X%252F2025-11-11%252Fimage%252F1d5bc75a-2ae4-42c1-aa24-990f771ada9c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NMN170X/2025-11-11/image/1d5bc75a-2ae4-42c1-aa24-990f771ada9c_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 84cf3344-bd7b-532c-932d-f1a9fc1fc3e0 with identifier: 117548617
2025-12-01 19:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 84cf3344-bd7b-532c-932d-f1a9fc1fc3e0 with identifier: 117548617
2025-12-01 19:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 84cf3344-bd7b-532c-932d-f1a9fc1fc3e0 with identifier: 117548617 to the API
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2784cf3344-bd7b-532c-932d-f1a9fc1fc3e0%27 HTTP/1.1" 200 None
2025-12-01 19:01:35 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 84cf3344-bd7b-532c-932d-f1a9fc1fc3e0: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:01:34 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117548617?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '84cf3344-bd7b-532c-932d-f1a9fc1fc3e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DF23VHW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117548617',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 41176,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-24',
 'seller_name': 'Accident Exchange',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2023}
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117548617%27 HTTP/1.1" 200 None
2025-12-01 19:01:35 [astonbarclay.gb] INFO: Saving data for 117548617: {'created_time': 1764615695.845042, 'last_price_update_time': 1764615695.845056, 'auction_closing_time': 1764927900.0}
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117548617') HTTP/1.1" 204 0
2025-12-01 19:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ac0a4f7c-5d1c-59ed-a946-6f8e53df1fcd with identifier: 117638131
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-01 19:01:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GREY%2FBLACK HTTP/1.1" 200 None
2025-12-01 19:01:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-01 19:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ac0a4f7c-5d1c-59ed-a946-6f8e53df1fcd with identifier: 117638131
2025-12-01 19:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'renault scenic e-tech electric estate 160kw esprit alpine 87kwh long range 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'renault', 'model': 'scenic e-tech electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 15869, 'odometer_reading_unit': 'mi', 'registration_date': '2024-12-23', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117638131', 'expiration_date': '2025-12-09t10:15:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '160kw esprit alpine 87kwh long range 5dr auto', 'license_plate': 'md74zcx', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'ac0a4f7c-5d1c-59ed-a946-6f8e53df1fcd', 'current_year_diff': 1, 'age_in_months': 11, 'make_model': 'renault scenic e-tech electric estate', 'sanitized_make': 'renault', 'odometer_in_km': 25538} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 11,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-09t10:15:00z',
     'fuel_type': 'electric',
     'id': 'ac0a4f7c-5d1c-59ed-a946-6f8e53df1fcd',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'md74zcx',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117638131',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'renault',
     'make_model': 'renault scenic e-tech electric estate',
     'model': 'scenic e-tech electric estate',
     'odometer': 15869,
     'odometer_in_km': 25538,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-12-23',
     'sanitized_make': 'renault',
     'seller_name': 'motability operations',
     'title': 'renault scenic e-tech electric estate 160kw esprit alpine '
              '87kwh long range 5dr auto',
     'transmission': 'automatic',
     'trim': '160kw esprit alpine 87kwh long range 5dr auto',
     'vin': None,
     'year': 2024}
2025-12-01 19:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: ac0a4f7c-5d1c-59ed-a946-6f8e53df1fcd spider: astonbarclay.gb
2025-12-01 19:01:36 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: ac0a4f7c-5d1c-59ed-a946-6f8e53df1fcd due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'renault scenic e-tech electric estate 160kw esprit alpine 87kwh long range 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'renault', 'model': 'scenic e-tech electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 15869, 'odometer_reading_unit': 'mi', 'registration_date': '2024-12-23', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117638131', 'expiration_date': '2025-12-09t10:15:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '160kw esprit alpine 87kwh long range 5dr auto', 'license_plate': 'md74zcx', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'ac0a4f7c-5d1c-59ed-a946-6f8e53df1fcd', 'current_year_diff': 1, 'age_in_months': 11, 'make_model': 'renault scenic e-tech electric estate', 'sanitized_make': 'renault', 'odometer_in_km': 25538} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 11,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-09t10:15:00z',
     'fuel_type': 'electric',
     'id': 'ac0a4f7c-5d1c-59ed-a946-6f8e53df1fcd',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'md74zcx',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117638131',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'renault',
     'make_model': 'renault scenic e-tech electric estate',
     'model': 'scenic e-tech electric estate',
     'odometer': 15869,
     'odometer_in_km': 25538,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-12-23',
     'sanitized_make': 'renault',
     'seller_name': 'motability operations',
     'title': 'renault scenic e-tech electric estate 160kw esprit alpine '
              '87kwh long range 5dr auto',
     'transmission': 'automatic',
     'trim': '160kw esprit alpine 87kwh long range 5dr auto',
     'vin': None,
     'year': 2024}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Electric',
 'id': 'ac0a4f7c-5d1c-59ed-a946-6f8e53df1fcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MD74ZCX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117638131',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'RENAULT',
 'model': 'SCENIC E-TECH ELECTRIC ESTATE',
 'odometer': 15869,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-23',
 'seller_name': 'Motability Operations',
 'title': 'RENAULT SCENIC E-TECH ELECTRIC ESTATE 160kW Esprit Alpine 87kWh '
          'Long Range 5dr Auto',
 'transmission': 'automatic',
 'trim': '160kW Esprit Alpine 87kWh Long Range 5dr Auto',
 'vin': None,
 'year': 2024}
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117638131%27 HTTP/1.1" 200 None
2025-12-01 19:01:36 [astonbarclay.gb] INFO: Saving data for 117638131: {'created_time': 1764615696.276207, 'last_price_update_time': 1764615696.276217, 'auction_closing_time': 1765275300.0}
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117638131') HTTP/1.1" 204 0
2025-12-01 19:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e83a350>
2025-12-01 19:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b55ecf4d-4b7d-502e-8147-27eca949960d/b55ecf4d-4b7d-502e-8147-27eca949960d_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYB68EYD%252F2025-12-01%252Fimage%252Fb3d45017-8f2c-4c9d-b363-e07e5be30477_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB68EYD/2025-12-01/image/b3d45017-8f2c-4c9d-b363-e07e5be30477_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b55ecf4d-4b7d-502e-8147-27eca949960d
2025-12-01 19:01:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117631028, 'registration': 'WM74SKU', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'KONA ELECTRIC HATCHBACK', 'derivative': '115kW Advance 48kWh 5dr Auto', 'mileage': 3924, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 149}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2024-12-23', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WM74SKU/2025-12-01/image/b36bc038-1ceb-4985-b979-7d44e34d38f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/ad2cffda-bd26-48eb-96ed-5eb93761ff11_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/1ca77b06-d499-49f2-9c80-7f072067b589_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/988bb02b-b1e1-4657-a0d7-52cce11f65ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/587dfa67-ca2c-494b-828e-c6a280ec1e9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/8890e246-99e3-455b-bba6-a2f679994482_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/e4e81195-fdef-41a2-9e68-635f3ef09faf_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/496a4694-5649-4221-b3cb-00663c6294a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/c9ae33f4-eb6f-46f9-b3dc-22283d870fc2_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/882a1277-8154-4c61-ac9b-05ebbfb39dab_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'spare key in office', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117631028, 'registration': 'WM74SKU', 'account': 'MOT070', 'make': 'HYUNDAI', 'model': 'KONA ELECTRIC HATCHBACK', 'derivative': '115kW Advance 48kWh 5dr Auto', 'mileage': 3924, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 149}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2024-12-23', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WM74SKU/2025-12-01/image/b36bc038-1ceb-4985-b979-7d44e34d38f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/ad2cffda-bd26-48eb-96ed-5eb93761ff11_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/1ca77b06-d499-49f2-9c80-7f072067b589_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/988bb02b-b1e1-4657-a0d7-52cce11f65ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/587dfa67-ca2c-494b-828e-c6a280ec1e9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/8890e246-99e3-455b-bba6-a2f679994482_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/e4e81195-fdef-41a2-9e68-635f3ef09faf_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/496a4694-5649-4221-b3cb-00663c6294a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/c9ae33f4-eb6f-46f9-b3dc-22283d870fc2_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/882a1277-8154-4c61-ac9b-05ebbfb39dab_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'spare key in office', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7fd25af-1c0c-5745-a7fa-634525bcac68 with identifier: 117631028
2025-12-01 19:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7fd25af-1c0c-5745-a7fa-634525bcac68 with scrape type 1
2025-12-01 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a7fd25af-1c0c-5745-a7fa-634525bcac68
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM74SKU%252F2025-12-01%252Fimage%252Fb36bc038-1ceb-4985-b979-7d44e34d38f4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM74SKU/2025-12-01/image/b36bc038-1ceb-4985-b979-7d44e34d38f4_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/A2UOV/2025-09-18/image/b3ecb7cb-8fe0-4ff3-8538-4ab8db299eeb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/115422003?view=catalogue)
2025-12-01 19:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YB68EYD/2025-12-01/image/bf073061-5882-496e-a357-cb101bf98c61_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117622575?view=catalogue)
2025-12-01 19:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LL67GVP/2025-12-01/image/9a25b8d0-6ad5-4202-b9b0-619877fe6421_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616437?view=catalogue)
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYB68EYD%252F2025-12-01%252Fimage%252F28ef779c-4b37-443f-8c37-ecc5de216dca_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB68EYD/2025-12-01/image/28ef779c-4b37-443f-8c37-ecc5de216dca_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NMN170X/2025-11-11/image/cc4aa83c-ec05-4c40-b921-5acf5a4d607e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117099385?view=catalogue)
2025-12-01 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117547832
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547832%27 HTTP/1.1" 200 None
2025-12-01 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117547832: 1
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPMN202V%252F2025-11-06%252Fimage%252F519d201f-a070-4799-bd55-5138dac9854e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PMN202V/2025-11-06/image/519d201f-a070-4799-bd55-5138dac9854e_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNMN170X%252F2025-11-11%252Fimage%252F024c4b16-7aa6-4e47-8df8-be8725f063f9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NMN170X/2025-11-11/image/024c4b16-7aa6-4e47-8df8-be8725f063f9_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM74SKU%252F2025-12-01%252Fimage%252Fad2cffda-bd26-48eb-96ed-5eb93761ff11_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM74SKU/2025-12-01/image/ad2cffda-bd26-48eb-96ed-5eb93761ff11_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117613099?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117610728?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117491238?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117366549?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117627838?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e9726d0>
2025-12-01 19:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b55ecf4d-4b7d-502e-8147-27eca949960d/b55ecf4d-4b7d-502e-8147-27eca949960d_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYB68EYD%252F2025-12-01%252Fimage%252F2ef2c559-4b24-4bd4-9ed4-aa86d937a430_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB68EYD/2025-12-01/image/2ef2c559-4b24-4bd4-9ed4-aa86d937a430_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b55ecf4d-4b7d-502e-8147-27eca949960d
2025-12-01 19:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f25c990>
2025-12-01 19:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac69f87-d87d-50d2-929c-94d0a460224e/3ac69f87-d87d-50d2-929c-94d0a460224e_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL67GVP%252F2025-12-01%252Fimage%252F16a89b3c-cd63-487f-af12-84b1a3d22f93_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67GVP/2025-12-01/image/16a89b3c-cd63-487f-af12-84b1a3d22f93_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3ac69f87-d87d-50d2-929c-94d0a460224e
2025-12-01 19:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e69d610>
2025-12-01 19:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac69f87-d87d-50d2-929c-94d0a460224e/3ac69f87-d87d-50d2-929c-94d0a460224e_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL67GVP%252F2025-12-01%252Fimage%252F8a6483b1-8822-4cfc-8b04-db179dc22998_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67GVP/2025-12-01/image/8a6483b1-8822-4cfc-8b04-db179dc22998_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3ac69f87-d87d-50d2-929c-94d0a460224e
2025-12-01 19:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6c4e10>
2025-12-01 19:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e8ecdcf-db96-5832-a676-c26fb5f17208/5e8ecdcf-db96-5832-a676-c26fb5f17208_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FA2UOV%252F2025-09-18%252Fimage%252Fbf982db3-14dc-4ccf-9a01-8e41be32c5d8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/A2UOV/2025-09-18/image/bf982db3-14dc-4ccf-9a01-8e41be32c5d8_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5e8ecdcf-db96-5832-a676-c26fb5f17208
2025-12-01 19:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PMN202V/2025-11-06/image/f97d2254-1b9f-4735-a8ee-c695253d65f3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116997754?view=catalogue)
2025-12-01 19:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YB68EYD/2025-12-01/image/b80b57ff-f17c-4d88-bf34-bcee8192199a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117622575?view=catalogue)
2025-12-01 19:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NMN170X/2025-11-11/image/d25140bf-37eb-452a-8d00-218d72db8d72_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117099385?view=catalogue)
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117584969
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584969%27 HTTP/1.1" 200 None
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117584969: 0
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117584960
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584960%27 HTTP/1.1" 200 None
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117584960: 0
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117543749
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117543749%27 HTTP/1.1" 200 None
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117543749: 0
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 116993535
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116993535%27 HTTP/1.1" 200 None
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Scrape type for 116993535: 0
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117567350
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117567350%27 HTTP/1.1" 200 None
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117567350: 0
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117021986
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117021986%27 HTTP/1.1" 200 None
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117021986: 0
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117120453
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117120453%27 HTTP/1.1" 200 None
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117120453: 0
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117120682
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117120682%27 HTTP/1.1" 200 None
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117120682: 0
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117118656
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117118656%27 HTTP/1.1" 200 None
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117118656: 0
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117119906
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117119906%27 HTTP/1.1" 200 None
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117119906: 0
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117230187
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117230187%27 HTTP/1.1" 200 None
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117230187: 0
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117242472
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117242472%27 HTTP/1.1" 200 None
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117242472: 0
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117140308
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117140308%27 HTTP/1.1" 200 None
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117140308: 0
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117372557
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117372557%27 HTTP/1.1" 200 None
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117372557: 0
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117362589
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117362589%27 HTTP/1.1" 200 None
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117362589: 0
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117327029
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117327029%27 HTTP/1.1" 200 None
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117327029: 0
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117273524
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117273524%27 HTTP/1.1" 200 None
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117273524: 0
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117253368
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117253368%27 HTTP/1.1" 200 None
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117253368: 0
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117242944
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117242944%27 HTTP/1.1" 200 None
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117242944: 0
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117271012
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117271012%27 HTTP/1.1" 200 None
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117271012: 0
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117214479
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117214479%27 HTTP/1.1" 200 None
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117214479: 0
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117194162
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117194162%27 HTTP/1.1" 200 None
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117194162: 0
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117178030
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117178030%27 HTTP/1.1" 200 None
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117178030: 0
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117208422
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117208422%27 HTTP/1.1" 200 None
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117208422: 0
2025-12-01 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117185008
2025-12-01 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117185008%27 HTTP/1.1" 200 None
2025-12-01 19:01:38 [astonbarclay.gb] INFO: Scrape type for 117185008: 1
2025-12-01 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPMN202V%252F2025-11-06%252Fimage%252Fc1878dca-49cf-4c27-84b6-6563db073c4c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PMN202V/2025-11-06/image/c1878dca-49cf-4c27-84b6-6563db073c4c_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNMN170X%252F2025-11-11%252Fimage%252Fac81bfcd-8c79-4074-bf0b-4c6326c92761_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NMN170X/2025-11-11/image/ac81bfcd-8c79-4074-bf0b-4c6326c92761_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM74SKU%252F2025-12-01%252Fimage%252F1ca77b06-d499-49f2-9c80-7f072067b589_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM74SKU/2025-12-01/image/1ca77b06-d499-49f2-9c80-7f072067b589_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YB68EYD/2025-12-01/image/abd0c03b-e3a4-43a5-881a-fdf2ef75970a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117622575?view=catalogue)
2025-12-01 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PMN202V/2025-11-06/image/1e4e2a67-6936-45b0-a38f-82b2eaf5e37a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116997754?view=catalogue)
2025-12-01 19:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e81e850>
2025-12-01 19:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e8ecdcf-db96-5832-a676-c26fb5f17208/5e8ecdcf-db96-5832-a676-c26fb5f17208_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FA2UOV%252F2025-09-18%252Fimage%252Fb3ecb7cb-8fe0-4ff3-8538-4ab8db299eeb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/A2UOV/2025-09-18/image/b3ecb7cb-8fe0-4ff3-8538-4ab8db299eeb_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5e8ecdcf-db96-5832-a676-c26fb5f17208
2025-12-01 19:01:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5e8ecdcf-db96-5832-a676-c26fb5f17208, skipping ID generation
2025-12-01 19:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e8ecdcf-db96-5832-a676-c26fb5f17208 with scrape type 1
2025-12-01 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5e8ecdcf-db96-5832-a676-c26fb5f17208 from tracking dictionaries
2025-12-01 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5e8ecdcf-db96-5832-a676-c26fb5f17208 sending to next pipeline
2025-12-01 19:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5e8ecdcf-db96-5832-a676-c26fb5f17208, identifier: 115422003
2025-12-01 19:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e883350>
2025-12-01 19:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b55ecf4d-4b7d-502e-8147-27eca949960d/b55ecf4d-4b7d-502e-8147-27eca949960d_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYB68EYD%252F2025-12-01%252Fimage%252Fbf073061-5882-496e-a357-cb101bf98c61_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB68EYD/2025-12-01/image/bf073061-5882-496e-a357-cb101bf98c61_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b55ecf4d-4b7d-502e-8147-27eca949960d
2025-12-01 19:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e579390>
2025-12-01 19:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac69f87-d87d-50d2-929c-94d0a460224e/3ac69f87-d87d-50d2-929c-94d0a460224e_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLL67GVP%252F2025-12-01%252Fimage%252F9a25b8d0-6ad5-4202-b9b0-619877fe6421_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LL67GVP/2025-12-01/image/9a25b8d0-6ad5-4202-b9b0-619877fe6421_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3ac69f87-d87d-50d2-929c-94d0a460224e
2025-12-01 19:01:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ac69f87-d87d-50d2-929c-94d0a460224e, skipping ID generation
2025-12-01 19:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ac69f87-d87d-50d2-929c-94d0a460224e with scrape type 1
2025-12-01 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3ac69f87-d87d-50d2-929c-94d0a460224e from tracking dictionaries
2025-12-01 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ac69f87-d87d-50d2-929c-94d0a460224e sending to next pipeline
2025-12-01 19:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3ac69f87-d87d-50d2-929c-94d0a460224e, identifier: 117616437
2025-12-01 19:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f70b890>
2025-12-01 19:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_affd00f4-2832-5372-b512-dce5abdf7275/affd00f4-2832-5372-b512-dce5abdf7275_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNMN170X%252F2025-11-11%252Fimage%252Fcc4aa83c-ec05-4c40-b921-5acf5a4d607e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NMN170X/2025-11-11/image/cc4aa83c-ec05-4c40-b921-5acf5a4d607e_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item affd00f4-2832-5372-b512-dce5abdf7275
2025-12-01 19:01:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117613099, 'registration': 'MT68EBF', 'account': 'VAN044', 'make': 'NISSAN', 'model': 'MICRA HATCHBACK', 'derivative': '0.9 IG-T N-Connecta 5dr', 'mileage': 40364, 'mileageWarranty': False, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-12-10', 'fuel': 'Petrol', 'motExpiry': '2026-06-29', 'doors': 5, 'engineSize': 898, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/073c8542-5c64-4b04-a9da-f42144a1caa8.jpg?w=600', 'https://abimg002.imgix.net/4202afd9-5436-49a3-aa7e-430b969a44ec.jpg?w=600', 'https://abimg002.imgix.net/322fb60e-126d-4a01-a866-9bc740d566ab.jpg?w=600', 'https://abimg002.imgix.net/287e56cf-7f7b-49e4-a42a-db3aae2172ea.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': 'VOSA STATES 11K, 14K, 19K, 28K, 36K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117613099, 'registration': 'MT68EBF', 'account': 'VAN044', 'make': 'NISSAN', 'model': 'MICRA HATCHBACK', 'derivative': '0.9 IG-T N-Connecta 5dr', 'mileage': 40364, 'mileageWarranty': False, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-12-10', 'fuel': 'Petrol', 'motExpiry': '2026-06-29', 'doors': 5, 'engineSize': 898, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/073c8542-5c64-4b04-a9da-f42144a1caa8.jpg?w=600', 'https://abimg002.imgix.net/4202afd9-5436-49a3-aa7e-430b969a44ec.jpg?w=600', 'https://abimg002.imgix.net/322fb60e-126d-4a01-a866-9bc740d566ab.jpg?w=600', 'https://abimg002.imgix.net/287e56cf-7f7b-49e4-a42a-db3aae2172ea.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': 'VOSA STATES 11K, 14K, 19K, 28K, 36K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d743ca24-9736-56bb-8379-98c4ba2e7cf2 with identifier: 117613099
2025-12-01 19:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d743ca24-9736-56bb-8379-98c4ba2e7cf2 with scrape type 1
2025-12-01 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item d743ca24-9736-56bb-8379-98c4ba2e7cf2
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F073c8542-5c64-4b04-a9da-f42144a1caa8.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/073c8542-5c64-4b04-a9da-f42144a1caa8.jpg?w=600 not downloaded yet
2025-12-01 19:01:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117610728, 'registration': 'KP67NPA', 'account': 'VAN040', 'make': 'VOLVO', 'model': 'XC60 DIESEL ESTATE', 'derivative': 'D4 [190] R DESIGN Lux Nav 5dr AWD Geartronic', 'mileage': 53987, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-09-29', 'fuel': 'Diesel', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 2400, 'bodyType': 'Estate', 'images': ['https://abimg002.imgix.net/eb04432f-dee8-467c-b612-a613fd17f291.jpg?w=600', 'https://abimg002.imgix.net/299edf6b-fd89-4b09-bc7b-cbbca3dae92f.jpg?w=600', 'https://abimg002.imgix.net/c207063b-b49b-46dd-8a34-9869f84ae358.jpg?w=600', 'https://abimg002.imgix.net/5978d2fc-d80a-4fb9-b6c2-3eba4b955fd7.jpg?w=600', 'https://abimg002.imgix.net/40fa855d-edee-4715-a329-508368f3efd2.jpg?w=600', 'https://abimg002.imgix.net/abe328a8-429f-4c12-ad80-e4e148c48679.jpg?w=600', 'https://abimg002.imgix.net/328bf1f9-5cfb-446e-b07d-5962f453a871.jpg?w=600', 'https://abimg002.imgix.net/a09ffd85-aa9c-4794-a662-3a2a796086de.jpg?w=600', 'https://abimg002.imgix.net/eb66f7d8-e6e2-4fbc-9292-1f064c93c791.jpg?w=600', 'https://abimg002.imgix.net/650216a1-c723-4e6d-94d7-f75a778e1e9f.jpg?w=600', 'https://abimg002.imgix.net/e68f76e3-5134-4041-abe5-4fef8c59ae05.jpg?w=600', 'https://abimg002.imgix.net/cdccb1ad-e1d6-4201-aa56-dac4693cb326.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': 'VOSA STATES  24K, 27K, 34K, 42K,46K, 52K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117610728, 'registration': 'KP67NPA', 'account': 'VAN040', 'make': 'VOLVO', 'model': 'XC60 DIESEL ESTATE', 'derivative': 'D4 [190] R DESIGN Lux Nav 5dr AWD Geartronic', 'mileage': 53987, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-09-29', 'fuel': 'Diesel', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 2400, 'bodyType': 'Estate', 'images': ['https://abimg002.imgix.net/eb04432f-dee8-467c-b612-a613fd17f291.jpg?w=600', 'https://abimg002.imgix.net/299edf6b-fd89-4b09-bc7b-cbbca3dae92f.jpg?w=600', 'https://abimg002.imgix.net/c207063b-b49b-46dd-8a34-9869f84ae358.jpg?w=600', 'https://abimg002.imgix.net/5978d2fc-d80a-4fb9-b6c2-3eba4b955fd7.jpg?w=600', 'https://abimg002.imgix.net/40fa855d-edee-4715-a329-508368f3efd2.jpg?w=600', 'https://abimg002.imgix.net/abe328a8-429f-4c12-ad80-e4e148c48679.jpg?w=600', 'https://abimg002.imgix.net/328bf1f9-5cfb-446e-b07d-5962f453a871.jpg?w=600', 'https://abimg002.imgix.net/a09ffd85-aa9c-4794-a662-3a2a796086de.jpg?w=600', 'https://abimg002.imgix.net/eb66f7d8-e6e2-4fbc-9292-1f064c93c791.jpg?w=600', 'https://abimg002.imgix.net/650216a1-c723-4e6d-94d7-f75a778e1e9f.jpg?w=600', 'https://abimg002.imgix.net/e68f76e3-5134-4041-abe5-4fef8c59ae05.jpg?w=600', 'https://abimg002.imgix.net/cdccb1ad-e1d6-4201-aa56-dac4693cb326.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': 'VOSA STATES  24K, 27K, 34K, 42K,46K, 52K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b4471d1-1330-5f18-bc6b-f50165d7cebc with identifier: 117610728
2025-12-01 19:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b4471d1-1330-5f18-bc6b-f50165d7cebc with scrape type 1
2025-12-01 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 9b4471d1-1330-5f18-bc6b-f50165d7cebc
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Feb04432f-dee8-467c-b612-a613fd17f291.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/eb04432f-dee8-467c-b612-a613fd17f291.jpg?w=600 not downloaded yet
2025-12-01 19:01:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117491238, 'registration': 'FN74GDE', 'account': 'MIN015', 'make': 'SEAT', 'model': 'ARONA HATCHBACK', 'derivative': '1.0 TSI 115 SE Technology 5dr DSG', 'mileage': 8976, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 216}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-10-01', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Mint Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 127, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/da88a1be-0c08-464d-ad81-ef0aa20caf60.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-01 19:01:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117491238, 'registration': 'FN74GDE', 'account': 'MIN015', 'make': 'SEAT', 'model': 'ARONA HATCHBACK', 'derivative': '1.0 TSI 115 SE Technology 5dr DSG', 'mileage': 8976, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 216}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2024-10-01', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Mint Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 127, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/da88a1be-0c08-464d-ad81-ef0aa20caf60.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-01 19:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 679a8f57-e986-5f38-9912-6b59f7237581 with identifier: 117491238
2025-12-01 19:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 679a8f57-e986-5f38-9912-6b59f7237581 with scrape type 1
2025-12-01 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 679a8f57-e986-5f38-9912-6b59f7237581
2025-12-01 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 679a8f57-e986-5f38-9912-6b59f7237581
2025-12-01 19:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 679a8f57-e986-5f38-9912-6b59f7237581, identifier: 117491238
2025-12-01 19:01:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117366549, 'registration': 'AGZ6324', 'account': 'ZUT001', 'make': 'PEUGEOT', 'model': '308 DIESEL HATCHBACK', 'derivative': '2.0 BlueHDi 180 GT 5dr EAT6', 'mileage': 81197, 'mileageWarranty': False, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-01-29', 'fuel': 'Diesel', 'motExpiry': '2025-11-01', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AGZ6324/2025-11-20/image/38c76a2d-bd26-4a20-ae91-47ad52873139_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/82383630-4335-41a7-accc-e663916cc43f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/c4816a9a-bec7-4018-aa0e-12a4af35d00e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/32fb6d3b-f9f0-4692-9be9-cc39a5c3ed36_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/51b98e9a-1ced-4cce-8c82-14bd500e0a3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/38e90add-4c25-423d-8f23-4d4c55296da8_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/677c4639-db7f-4981-b0cd-1eace3bbaf49_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/1e157848-7440-412b-ba3f-c616f234cca1_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/4c4b08ca-f6e7-4fc6-9f40-7f0695d05a60_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 57K,70K, 75K, 77K, 77K, 77K,', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '5', 'v5': False, 'v5details': None, 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117366549, 'registration': 'AGZ6324', 'account': 'ZUT001', 'make': 'PEUGEOT', 'model': '308 DIESEL HATCHBACK', 'derivative': '2.0 BlueHDi 180 GT 5dr EAT6', 'mileage': 81197, 'mileageWarranty': False, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-01-29', 'fuel': 'Diesel', 'motExpiry': '2025-11-01', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AGZ6324/2025-11-20/image/38c76a2d-bd26-4a20-ae91-47ad52873139_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/82383630-4335-41a7-accc-e663916cc43f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/c4816a9a-bec7-4018-aa0e-12a4af35d00e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/32fb6d3b-f9f0-4692-9be9-cc39a5c3ed36_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/51b98e9a-1ced-4cce-8c82-14bd500e0a3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/38e90add-4c25-423d-8f23-4d4c55296da8_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/677c4639-db7f-4981-b0cd-1eace3bbaf49_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/1e157848-7440-412b-ba3f-c616f234cca1_removebg.jpg?w=600', 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/4c4b08ca-f6e7-4fc6-9f40-7f0695d05a60_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 57K,70K, 75K, 77K, 77K, 77K,', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '5', 'v5': False, 'v5details': None, 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d1d41c3-9a55-5035-95b3-78f2642f8712 with identifier: 117366549
2025-12-01 19:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d1d41c3-9a55-5035-95b3-78f2642f8712 with scrape type 1
2025-12-01 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 8d1d41c3-9a55-5035-95b3-78f2642f8712
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAGZ6324%252F2025-11-20%252Fimage%252F38c76a2d-bd26-4a20-ae91-47ad52873139_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AGZ6324/2025-11-20/image/38c76a2d-bd26-4a20-ae91-47ad52873139_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117627838, 'registration': '5BSW', 'account': 'HAT008', 'make': 'LAND ROVER', 'model': 'DISCOVERY DIESEL SW', 'derivative': '3.0 SD6 HSE Luxury 5dr Auto', 'mileage': 117101, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-09-27', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 5, 'engineSize': 2993, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 10/20- 6K, 10/21- 19K, 05/22- 35K, 01/23- 51K, 09/23- 68K, 06/24- 85K, 03/25- 102K', 'remarks': '**24** VOSA STATES 44K, 68K, 91K, 112K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 198, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6ca8aa8c-7454-4bf9-bdd5-48fd203380b4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117627838, 'registration': '5BSW', 'account': 'HAT008', 'make': 'LAND ROVER', 'model': 'DISCOVERY DIESEL SW', 'derivative': '3.0 SD6 HSE Luxury 5dr Auto', 'mileage': 117101, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-09-27', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 5, 'engineSize': 2993, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 10/20- 6K, 10/21- 19K, 05/22- 35K, 01/23- 51K, 09/23- 68K, 06/24- 85K, 03/25- 102K', 'remarks': '**24** VOSA STATES 44K, 68K, 91K, 112K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 198, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6ca8aa8c-7454-4bf9-bdd5-48fd203380b4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8794730-72b1-5d18-a3b5-7236d934a6cc with identifier: 117627838
2025-12-01 19:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8794730-72b1-5d18-a3b5-7236d934a6cc with scrape type 1
2025-12-01 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item d8794730-72b1-5d18-a3b5-7236d934a6cc
2025-12-01 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item d8794730-72b1-5d18-a3b5-7236d934a6cc
2025-12-01 19:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d8794730-72b1-5d18-a3b5-7236d934a6cc, identifier: 117627838
2025-12-01 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YB68EYD/2025-12-01/image/28ef779c-4b37-443f-8c37-ecc5de216dca_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117622575?view=catalogue)
2025-12-01 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NMN170X/2025-11-11/image/1d5bc75a-2ae4-42c1-aa24-990f771ada9c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117099385?view=catalogue)
2025-12-01 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PMN202V/2025-11-06/image/8ea2c304-2809-49ac-9e6a-855eb478d2e6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116997754?view=catalogue)
2025-12-01 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM74SKU/2025-12-01/image/b36bc038-1ceb-4985-b979-7d44e34d38f4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117631028?view=catalogue)
2025-12-01 19:01:39 [astonbarclay.gb] INFO: Found listing with ID: 115926008
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115926008%27 HTTP/1.1" 200 None
2025-12-01 19:01:39 [astonbarclay.gb] INFO: Scrape type for 115926008: 0
2025-12-01 19:01:39 [astonbarclay.gb] INFO: Found listing with ID: 116378959
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116378959%27 HTTP/1.1" 200 None
2025-12-01 19:01:39 [astonbarclay.gb] INFO: Scrape type for 116378959: 0
2025-12-01 19:01:39 [astonbarclay.gb] INFO: Found listing with ID: 114698400
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114698400%27 HTTP/1.1" 200 None
2025-12-01 19:01:39 [astonbarclay.gb] INFO: Scrape type for 114698400: 0
2025-12-01 19:01:39 [astonbarclay.gb] INFO: Found listing with ID: 114700069
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114700069%27 HTTP/1.1" 200 None
2025-12-01 19:01:39 [astonbarclay.gb] INFO: Scrape type for 114700069: 0
2025-12-01 19:01:39 [astonbarclay.gb] INFO: Found listing with ID: 117415829
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117415829%27 HTTP/1.1" 200 None
2025-12-01 19:01:39 [astonbarclay.gb] INFO: Scrape type for 117415829: 1
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPMN202V%252F2025-11-06%252Fimage%252F2d168458-ec89-4e83-9133-176e41a70955_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PMN202V/2025-11-06/image/2d168458-ec89-4e83-9133-176e41a70955_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNMN170X%252F2025-11-11%252Fimage%252F45ced919-696c-4e83-88ba-f21bb72ca49a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NMN170X/2025-11-11/image/45ced919-696c-4e83-88ba-f21bb72ca49a_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM74SKU%252F2025-12-01%252Fimage%252F988bb02b-b1e1-4657-a0d7-52cce11f65ee_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM74SKU/2025-12-01/image/988bb02b-b1e1-4657-a0d7-52cce11f65ee_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5e8ecdcf-db96-5832-a676-c26fb5f17208 with identifier: 115422003
2025-12-01 19:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5e8ecdcf-db96-5832-a676-c26fb5f17208 with identifier: 115422003
2025-12-01 19:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5e8ecdcf-db96-5832-a676-c26fb5f17208 with identifier: 115422003 to the API
2025-12-01 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/A2UOV/2025-09-18/image/b3ecb7cb-8fe0-4ff3-8538-4ab8db299eeb_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 197,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '5e8ecdcf-db96-5832-a676-c26fb5f17208',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'A2UOV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115422003',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC HATCHBACK',
 'odometer': 57752,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e8ecdcf-db96-5832-a676-c26fb5f17208/5e8ecdcf-db96-5832-a676-c26fb5f17208_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32326,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/ccc15175-e3bf-4e00-ad0d-132ada753d1f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e8ecdcf-db96-5832-a676-c26fb5f17208/5e8ecdcf-db96-5832-a676-c26fb5f17208_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38113,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/32485ed9-e7a8-4072-8dd0-6aa655fc8b2c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e8ecdcf-db96-5832-a676-c26fb5f17208/5e8ecdcf-db96-5832-a676-c26fb5f17208_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32908,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/193d37ce-cb43-472e-9ffc-c01f047e2690_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e8ecdcf-db96-5832-a676-c26fb5f17208/5e8ecdcf-db96-5832-a676-c26fb5f17208_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38761,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/b3ecb7cb-8fe0-4ff3-8538-4ab8db299eeb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e8ecdcf-db96-5832-a676-c26fb5f17208/5e8ecdcf-db96-5832-a676-c26fb5f17208_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52361,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/fe6a0c77-4db4-447f-af9e-89669cd126ea_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e8ecdcf-db96-5832-a676-c26fb5f17208/5e8ecdcf-db96-5832-a676-c26fb5f17208_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48211,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/ae94a4ee-997e-45e6-8277-7da0a0643237_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e8ecdcf-db96-5832-a676-c26fb5f17208/5e8ecdcf-db96-5832-a676-c26fb5f17208_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43988,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/A2UOV/2025-09-18/image/bf982db3-14dc-4ccf-9a01-8e41be32c5d8_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-10',
 'seller_name': 'Stellantis Financial Services UK',
 'title': 'VOLKSWAGEN T-ROC HATCHBACK 2.0 TSI 4MOTION R 5dr DSG',
 'transmission': 'automatic',
 'trim': '2.0 TSI 4MOTION R 5dr DSG',
 'vin': None,
 'year': 2020}
2025-12-01 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115422003%27 HTTP/1.1" 200 None
2025-12-01 19:01:40 [astonbarclay.gb] INFO: Saving data for 115422003: {'created_time': 1764615700.204448, 'last_price_update_time': 1764615700.204459, 'auction_closing_time': 1765188000.0}
2025-12-01 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='115422003') HTTP/1.1" 204 0
2025-12-01 19:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3ac69f87-d87d-50d2-929c-94d0a460224e with identifier: 117616437
2025-12-01 19:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3ac69f87-d87d-50d2-929c-94d0a460224e with identifier: 117616437
2025-12-01 19:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 170577 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    170577
2025-12-01 19:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3ac69f87-d87d-50d2-929c-94d0a460224e spider: astonbarclay.gb
2025-12-01 19:01:40 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 3ac69f87-d87d-50d2-929c-94d0a460224e due to rule: high_mileage_for_country.json, error: 170577 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    170577
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': '3ac69f87-d87d-50d2-929c-94d0a460224e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LL67GVP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117616437',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS HATCHBACK',
 'odometer': 105992,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac69f87-d87d-50d2-929c-94d0a460224e/3ac69f87-d87d-50d2-929c-94d0a460224e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27799,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LL67GVP/2025-12-01/image/2684b4b5-f27a-4ec5-9df2-78402a3ec932_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac69f87-d87d-50d2-929c-94d0a460224e/3ac69f87-d87d-50d2-929c-94d0a460224e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29660,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LL67GVP/2025-12-01/image/0deb3815-cf8a-42c5-b69b-200686c56332_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac69f87-d87d-50d2-929c-94d0a460224e/3ac69f87-d87d-50d2-929c-94d0a460224e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30261,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LL67GVP/2025-12-01/image/64bca94c-3a14-464b-8eee-169f63b687bb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac69f87-d87d-50d2-929c-94d0a460224e/3ac69f87-d87d-50d2-929c-94d0a460224e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29559,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LL67GVP/2025-12-01/image/24152e49-9701-4912-a2b1-265b5a8dd3b3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac69f87-d87d-50d2-929c-94d0a460224e/3ac69f87-d87d-50d2-929c-94d0a460224e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49973,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LL67GVP/2025-12-01/image/c7ddf0f7-ff4e-4390-bf5e-0538de35b916_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac69f87-d87d-50d2-929c-94d0a460224e/3ac69f87-d87d-50d2-929c-94d0a460224e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102800,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/LL67GVP/2025-12-01/image/f034c8a2-dc84-4397-8de2-3604b84f9cb7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac69f87-d87d-50d2-929c-94d0a460224e/3ac69f87-d87d-50d2-929c-94d0a460224e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89857,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/LL67GVP/2025-12-01/image/8a6483b1-8822-4cfc-8b04-db179dc22998_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac69f87-d87d-50d2-929c-94d0a460224e/3ac69f87-d87d-50d2-929c-94d0a460224e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55080,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LL67GVP/2025-12-01/image/16a89b3c-cd63-487f-af12-84b1a3d22f93_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac69f87-d87d-50d2-929c-94d0a460224e/3ac69f87-d87d-50d2-929c-94d0a460224e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38919,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/LL67GVP/2025-12-01/image/9a25b8d0-6ad5-4202-b9b0-619877fe6421_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-31',
 'seller_name': 'UKCGR - Select',
 'title': 'MERCEDES-BENZ A CLASS HATCHBACK A180 AMG Line 5dr Auto',
 'transmission': 'automatic',
 'trim': 'A180 AMG Line 5dr Auto',
 'vin': None,
 'year': 2018}
2025-12-01 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117616437%27 HTTP/1.1" 200 None
2025-12-01 19:01:40 [astonbarclay.gb] INFO: Saving data for 117616437: {'created_time': 1764615700.496353, 'last_price_update_time': 1764615700.496363, 'auction_closing_time': 1765215000.0}
2025-12-01 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117616437') HTTP/1.1" 204 0
2025-12-01 19:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 679a8f57-e986-5f38-9912-6b59f7237581 with identifier: 117491238
2025-12-01 19:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 679a8f57-e986-5f38-9912-6b59f7237581 with identifier: 117491238
2025-12-01 19:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 679a8f57-e986-5f38-9912-6b59f7237581 with identifier: 117491238 to the API
2025-12-01 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27679a8f57-e986-5f38-9912-6b59f7237581%27 HTTP/1.1" 200 None
2025-12-01 19:01:40 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 679a8f57-e986-5f38-9912-6b59f7237581: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:01:39 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117491238?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '679a8f57-e986-5f38-9912-6b59f7237581',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'FN74GDE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117491238',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'SEAT',
 'model': 'ARONA HATCHBACK',
 'odometer': 8976,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-01',
 'seller_name': 'Mint Automotive',
 'title': 'SEAT ARONA HATCHBACK 1.0 TSI 115 SE Technology 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.0 TSI 115 SE Technology 5dr DSG',
 'vin': None,
 'year': 2024}
2025-12-01 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117491238%27 HTTP/1.1" 200 None
2025-12-01 19:01:40 [astonbarclay.gb] INFO: Saving data for 117491238: {'created_time': 1764615700.790249, 'last_price_update_time': 1764615700.790263, 'auction_closing_time': 1764842400.0}
2025-12-01 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117491238') HTTP/1.1" 204 0
2025-12-01 19:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d8794730-72b1-5d18-a3b5-7236d934a6cc with identifier: 117627838
2025-12-01 19:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d8794730-72b1-5d18-a3b5-7236d934a6cc with identifier: 117627838
2025-12-01 19:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 188455 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    188455
2025-12-01 19:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d8794730-72b1-5d18-a3b5-7236d934a6cc spider: astonbarclay.gb
2025-12-01 19:01:40 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: d8794730-72b1-5d18-a3b5-7236d934a6cc due to rule: high_mileage_for_country.json, error: 188455 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    188455
{'auction_title': '',
 'c_o_2_emission_value': 198,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'd8794730-72b1-5d18-a3b5-7236d934a6cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': '5BSW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117627838',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'LAND ROVER',
 'model': 'DISCOVERY DIESEL SW',
 'odometer': 117101,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-27',
 'seller_name': 'Hatfields Group',
 'title': 'LAND ROVER DISCOVERY DIESEL SW 3.0 SD6 HSE Luxury 5dr Auto',
 'transmission': 'automatic',
 'trim': '3.0 SD6 HSE Luxury 5dr Auto',
 'vin': None,
 'year': 2019}
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117627838%27 HTTP/1.1" 200 None
2025-12-01 19:01:41 [astonbarclay.gb] INFO: Saving data for 117627838: {'created_time': 1764615701.011682, 'last_price_update_time': 1764615701.011692, 'auction_closing_time': 1765285200.0}
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117627838') HTTP/1.1" 204 0
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F4202afd9-5436-49a3-aa7e-430b969a44ec.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/4202afd9-5436-49a3-aa7e-430b969a44ec.jpg?w=600 not downloaded yet
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F299edf6b-fd89-4b09-bc7b-cbbca3dae92f.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/299edf6b-fd89-4b09-bc7b-cbbca3dae92f.jpg?w=600 not downloaded yet
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAGZ6324%252F2025-11-20%252Fimage%252F82383630-4335-41a7-accc-e663916cc43f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AGZ6324/2025-11-20/image/82383630-4335-41a7-accc-e663916cc43f_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e754210>
2025-12-01 19:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498a6fee-1e22-5c90-919f-b3db8c1a1fee/498a6fee-1e22-5c90-919f-b3db8c1a1fee_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPMN202V%252F2025-11-06%252Fimage%252Ff97d2254-1b9f-4735-a8ee-c695253d65f3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PMN202V/2025-11-06/image/f97d2254-1b9f-4735-a8ee-c695253d65f3_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 498a6fee-1e22-5c90-919f-b3db8c1a1fee
2025-12-01 19:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f25e490>
2025-12-01 19:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b55ecf4d-4b7d-502e-8147-27eca949960d/b55ecf4d-4b7d-502e-8147-27eca949960d_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYB68EYD%252F2025-12-01%252Fimage%252Fb80b57ff-f17c-4d88-bf34-bcee8192199a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB68EYD/2025-12-01/image/b80b57ff-f17c-4d88-bf34-bcee8192199a_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b55ecf4d-4b7d-502e-8147-27eca949960d
2025-12-01 19:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e777890>
2025-12-01 19:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_affd00f4-2832-5372-b512-dce5abdf7275/affd00f4-2832-5372-b512-dce5abdf7275_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNMN170X%252F2025-11-11%252Fimage%252Fd25140bf-37eb-452a-8d00-218d72db8d72_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NMN170X/2025-11-11/image/d25140bf-37eb-452a-8d00-218d72db8d72_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item affd00f4-2832-5372-b512-dce5abdf7275
2025-12-01 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PMN202V/2025-11-06/image/519d201f-a070-4799-bd55-5138dac9854e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116997754?view=catalogue)
2025-12-01 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NMN170X/2025-11-11/image/024c4b16-7aa6-4e47-8df8-be8725f063f9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117099385?view=catalogue)
2025-12-01 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM74SKU/2025-12-01/image/ad2cffda-bd26-48eb-96ed-5eb93761ff11_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117631028?view=catalogue)
2025-12-01 19:01:41 [astonbarclay.gb] INFO: Found listing with ID: 114344014
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114344014%27 HTTP/1.1" 200 None
2025-12-01 19:01:41 [astonbarclay.gb] INFO: Scrape type for 114344014: 0
2025-12-01 19:01:41 [astonbarclay.gb] INFO: Found listing with ID: 117580703
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117580703%27 HTTP/1.1" 200 None
2025-12-01 19:01:41 [astonbarclay.gb] INFO: Scrape type for 117580703: 0
2025-12-01 19:01:41 [astonbarclay.gb] INFO: Found listing with ID: 117581450
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117581450%27 HTTP/1.1" 200 None
2025-12-01 19:01:41 [astonbarclay.gb] INFO: Scrape type for 117581450: 0
2025-12-01 19:01:41 [astonbarclay.gb] INFO: Found listing with ID: 117416921
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117416921%27 HTTP/1.1" 200 None
2025-12-01 19:01:41 [astonbarclay.gb] INFO: Scrape type for 117416921: 1
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPMN202V%252F2025-11-06%252Fimage%252Ff5ad9c39-1cc5-491c-b845-ab2e80e9b6f7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PMN202V/2025-11-06/image/f5ad9c39-1cc5-491c-b845-ab2e80e9b6f7_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNMN170X%252F2025-11-11%252Fimage%252Fba0ea8d0-8420-479f-9ce9-c7383af8f69c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NMN170X/2025-11-11/image/ba0ea8d0-8420-479f-9ce9-c7383af8f69c_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM74SKU%252F2025-12-01%252Fimage%252F587dfa67-ca2c-494b-828e-c6a280ec1e9f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM74SKU/2025-12-01/image/587dfa67-ca2c-494b-828e-c6a280ec1e9f_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f262b10>
2025-12-01 19:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-01 19:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b55ecf4d-4b7d-502e-8147-27eca949960d/b55ecf4d-4b7d-502e-8147-27eca949960d_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYB68EYD%252F2025-12-01%252Fimage%252Fabd0c03b-e3a4-43a5-881a-fdf2ef75970a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB68EYD/2025-12-01/image/abd0c03b-e3a4-43a5-881a-fdf2ef75970a_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b55ecf4d-4b7d-502e-8147-27eca949960d
2025-12-01 19:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e892d50>
2025-12-01 19:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498a6fee-1e22-5c90-919f-b3db8c1a1fee/498a6fee-1e22-5c90-919f-b3db8c1a1fee_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPMN202V%252F2025-11-06%252Fimage%252F1e4e2a67-6936-45b0-a38f-82b2eaf5e37a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PMN202V/2025-11-06/image/1e4e2a67-6936-45b0-a38f-82b2eaf5e37a_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 498a6fee-1e22-5c90-919f-b3db8c1a1fee
2025-12-01 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ET17TNV/2025-12-01/image/008c7464-e0c0-4f44-9054-7f8ee27989ab_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117596913?view=catalogue)
2025-12-01 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F322fb60e-126d-4a01-a866-9bc740d566ab.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/322fb60e-126d-4a01-a866-9bc740d566ab.jpg?w=600 not downloaded yet
2025-12-01 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fc207063b-b49b-46dd-8a34-9869f84ae358.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/c207063b-b49b-46dd-8a34-9869f84ae358.jpg?w=600 not downloaded yet
2025-12-01 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAGZ6324%252F2025-11-20%252Fimage%252Fc4816a9a-bec7-4018-aa0e-12a4af35d00e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AGZ6324/2025-11-20/image/c4816a9a-bec7-4018-aa0e-12a4af35d00e_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e817e90>
2025-12-01 19:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b55ecf4d-4b7d-502e-8147-27eca949960d/b55ecf4d-4b7d-502e-8147-27eca949960d_image_9.jpg HTTP/1.1" 201 0
2025-12-01 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYB68EYD%252F2025-12-01%252Fimage%252F28ef779c-4b37-443f-8c37-ecc5de216dca_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB68EYD/2025-12-01/image/28ef779c-4b37-443f-8c37-ecc5de216dca_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b55ecf4d-4b7d-502e-8147-27eca949960d
2025-12-01 19:01:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b55ecf4d-4b7d-502e-8147-27eca949960d, skipping ID generation
2025-12-01 19:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b55ecf4d-4b7d-502e-8147-27eca949960d with scrape type 1
2025-12-01 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b55ecf4d-4b7d-502e-8147-27eca949960d from tracking dictionaries
2025-12-01 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b55ecf4d-4b7d-502e-8147-27eca949960d sending to next pipeline
2025-12-01 19:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b55ecf4d-4b7d-502e-8147-27eca949960d, identifier: 117622575
2025-12-01 19:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e814810>
2025-12-01 19:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_affd00f4-2832-5372-b512-dce5abdf7275/affd00f4-2832-5372-b512-dce5abdf7275_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNMN170X%252F2025-11-11%252Fimage%252F1d5bc75a-2ae4-42c1-aa24-990f771ada9c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NMN170X/2025-11-11/image/1d5bc75a-2ae4-42c1-aa24-990f771ada9c_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item affd00f4-2832-5372-b512-dce5abdf7275
2025-12-01 19:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e9a4910>
2025-12-01 19:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498a6fee-1e22-5c90-919f-b3db8c1a1fee/498a6fee-1e22-5c90-919f-b3db8c1a1fee_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPMN202V%252F2025-11-06%252Fimage%252F8ea2c304-2809-49ac-9e6a-855eb478d2e6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PMN202V/2025-11-06/image/8ea2c304-2809-49ac-9e6a-855eb478d2e6_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 498a6fee-1e22-5c90-919f-b3db8c1a1fee
2025-12-01 19:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f223c10>
2025-12-01 19:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM74SKU%252F2025-12-01%252Fimage%252Fb36bc038-1ceb-4985-b979-7d44e34d38f4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM74SKU/2025-12-01/image/b36bc038-1ceb-4985-b979-7d44e34d38f4_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7fd25af-1c0c-5745-a7fa-634525bcac68
2025-12-01 19:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PMN202V/2025-11-06/image/c1878dca-49cf-4c27-84b6-6563db073c4c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116997754?view=catalogue)
2025-12-01 19:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NMN170X/2025-11-11/image/ac81bfcd-8c79-4074-bf0b-4c6326c92761_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117099385?view=catalogue)
2025-12-01 19:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM74SKU/2025-12-01/image/1ca77b06-d499-49f2-9c80-7f072067b589_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117631028?view=catalogue)
2025-12-01 19:01:43 [astonbarclay.gb] INFO: Found listing with ID: 116188432
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116188432%27 HTTP/1.1" 200 None
2025-12-01 19:01:43 [astonbarclay.gb] INFO: Scrape type for 116188432: 0
2025-12-01 19:01:43 [astonbarclay.gb] INFO: Found listing with ID: 117023136
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117023136%27 HTTP/1.1" 200 None
2025-12-01 19:01:43 [astonbarclay.gb] INFO: Scrape type for 117023136: 1
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPMN202V%252F2025-11-06%252Fimage%252Ff977f8b0-f990-496a-8c97-91797d37ffc6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PMN202V/2025-11-06/image/f977f8b0-f990-496a-8c97-91797d37ffc6_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNMN170X%252F2025-11-11%252Fimage%252Fb4dd87c0-4f27-4d5f-830d-54edde2109fb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NMN170X/2025-11-11/image/b4dd87c0-4f27-4d5f-830d-54edde2109fb_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM74SKU%252F2025-12-01%252Fimage%252F8890e246-99e3-455b-bba6-a2f679994482_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM74SKU/2025-12-01/image/8890e246-99e3-455b-bba6-a2f679994482_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b55ecf4d-4b7d-502e-8147-27eca949960d with identifier: 117622575
2025-12-01 19:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b55ecf4d-4b7d-502e-8147-27eca949960d with identifier: 117622575
2025-12-01 19:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b55ecf4d-4b7d-502e-8147-27eca949960d with identifier: 117622575 to the API
2025-12-01 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YB68EYD/2025-12-01/image/28ef779c-4b37-443f-8c37-ecc5de216dca_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 86,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'b55ecf4d-4b7d-502e-8147-27eca949960d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YB68EYD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117622575',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'TOYOTA',
 'model': 'C-HR HATCHBACK',
 'odometer': 67438,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b55ecf4d-4b7d-502e-8147-27eca949960d/b55ecf4d-4b7d-502e-8147-27eca949960d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37365,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YB68EYD/2025-12-01/image/a73aeae7-0f3a-4387-ba2f-033e0e192672_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b55ecf4d-4b7d-502e-8147-27eca949960d/b55ecf4d-4b7d-502e-8147-27eca949960d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39086,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YB68EYD/2025-12-01/image/4b78d472-7505-4b14-8dd8-1ec9ccead57c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b55ecf4d-4b7d-502e-8147-27eca949960d/b55ecf4d-4b7d-502e-8147-27eca949960d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40873,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YB68EYD/2025-12-01/image/34e8c971-ed9e-4274-91ea-4acba1b07b35_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b55ecf4d-4b7d-502e-8147-27eca949960d/b55ecf4d-4b7d-502e-8147-27eca949960d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41052,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YB68EYD/2025-12-01/image/e8d6d2cf-97a5-4f7f-814b-fae6ce538cd3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b55ecf4d-4b7d-502e-8147-27eca949960d/b55ecf4d-4b7d-502e-8147-27eca949960d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45386,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YB68EYD/2025-12-01/image/b3d45017-8f2c-4c9d-b363-e07e5be30477_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b55ecf4d-4b7d-502e-8147-27eca949960d/b55ecf4d-4b7d-502e-8147-27eca949960d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51947,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YB68EYD/2025-12-01/image/2ef2c559-4b24-4bd4-9ed4-aa86d937a430_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b55ecf4d-4b7d-502e-8147-27eca949960d/b55ecf4d-4b7d-502e-8147-27eca949960d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41309,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YB68EYD/2025-12-01/image/bf073061-5882-496e-a357-cb101bf98c61_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b55ecf4d-4b7d-502e-8147-27eca949960d/b55ecf4d-4b7d-502e-8147-27eca949960d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48797,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YB68EYD/2025-12-01/image/b80b57ff-f17c-4d88-bf34-bcee8192199a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b55ecf4d-4b7d-502e-8147-27eca949960d/b55ecf4d-4b7d-502e-8147-27eca949960d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42048,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YB68EYD/2025-12-01/image/abd0c03b-e3a4-43a5-881a-fdf2ef75970a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b55ecf4d-4b7d-502e-8147-27eca949960d/b55ecf4d-4b7d-502e-8147-27eca949960d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51181,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YB68EYD/2025-12-01/image/28ef779c-4b37-443f-8c37-ecc5de216dca_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-10',
 'seller_name': 'Startline Motor Finance Ltd',
 'title': 'TOYOTA C-HR HATCHBACK 1.8 Hybrid Design 5dr CVT',
 'transmission': 'automatic',
 'trim': '1.8 Hybrid Design 5dr CVT',
 'vin': None,
 'year': 2019}
2025-12-01 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117622575%27 HTTP/1.1" 200 None
2025-12-01 19:01:44 [astonbarclay.gb] INFO: Saving data for 117622575: {'created_time': 1764615704.129456, 'last_price_update_time': 1764615704.129467, 'auction_closing_time': 1765188000.0}
2025-12-01 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117622575') HTTP/1.1" 204 0
2025-12-01 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F287e56cf-7f7b-49e4-a42a-db3aae2172ea.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/287e56cf-7f7b-49e4-a42a-db3aae2172ea.jpg?w=600 not downloaded yet
2025-12-01 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F5978d2fc-d80a-4fb9-b6c2-3eba4b955fd7.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/5978d2fc-d80a-4fb9-b6c2-3eba4b955fd7.jpg?w=600 not downloaded yet
2025-12-01 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAGZ6324%252F2025-11-20%252Fimage%252F32fb6d3b-f9f0-4692-9be9-cc39a5c3ed36_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AGZ6324/2025-11-20/image/32fb6d3b-f9f0-4692-9be9-cc39a5c3ed36_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/60238390?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117600618?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117578188?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117616509?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117547822?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f204990>
2025-12-01 19:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498a6fee-1e22-5c90-919f-b3db8c1a1fee/498a6fee-1e22-5c90-919f-b3db8c1a1fee_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPMN202V%252F2025-11-06%252Fimage%252F519d201f-a070-4799-bd55-5138dac9854e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PMN202V/2025-11-06/image/519d201f-a070-4799-bd55-5138dac9854e_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 498a6fee-1e22-5c90-919f-b3db8c1a1fee
2025-12-01 19:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6867d0>
2025-12-01 19:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-01 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_affd00f4-2832-5372-b512-dce5abdf7275/affd00f4-2832-5372-b512-dce5abdf7275_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNMN170X%252F2025-11-11%252Fimage%252F024c4b16-7aa6-4e47-8df8-be8725f063f9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NMN170X/2025-11-11/image/024c4b16-7aa6-4e47-8df8-be8725f063f9_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item affd00f4-2832-5372-b512-dce5abdf7275
2025-12-01 19:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e998b10>
2025-12-01 19:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM74SKU%252F2025-12-01%252Fimage%252Fad2cffda-bd26-48eb-96ed-5eb93761ff11_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM74SKU/2025-12-01/image/ad2cffda-bd26-48eb-96ed-5eb93761ff11_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7fd25af-1c0c-5745-a7fa-634525bcac68
2025-12-01 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NMN170X/2025-11-11/image/45ced919-696c-4e83-88ba-f21bb72ca49a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117099385?view=catalogue)
2025-12-01 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PMN202V/2025-11-06/image/2d168458-ec89-4e83-9133-176e41a70955_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116997754?view=catalogue)
2025-12-01 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM74SKU/2025-12-01/image/988bb02b-b1e1-4657-a0d7-52cce11f65ee_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117631028?view=catalogue)
2025-12-01 19:01:45 [astonbarclay.gb] INFO: Found listing with ID: 117080670
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117080670%27 HTTP/1.1" 200 None
2025-12-01 19:01:45 [astonbarclay.gb] INFO: Scrape type for 117080670: 1
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPMN202V%252F2025-11-06%252Fimage%252Fd7bb92e4-8f27-4797-a918-51ff41be9dd3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PMN202V/2025-11-06/image/d7bb92e4-8f27-4797-a918-51ff41be9dd3_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FNMN170X%252F2025-11-11%252Fimage%252F59610efb-1fa3-4ff1-a171-2348499bc6e1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NMN170X/2025-11-11/image/59610efb-1fa3-4ff1-a171-2348499bc6e1_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM74SKU%252F2025-12-01%252Fimage%252Fe4e81195-fdef-41a2-9e68-635f3ef09faf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM74SKU/2025-12-01/image/e4e81195-fdef-41a2-9e68-635f3ef09faf_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e54c5d0>
2025-12-01 19:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7553a85-b1d7-5800-8c41-acd80624ea68/c7553a85-b1d7-5800-8c41-acd80624ea68_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FET17TNV%252F2025-12-01%252Fimage%252F008c7464-e0c0-4f44-9054-7f8ee27989ab_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET17TNV/2025-12-01/image/008c7464-e0c0-4f44-9054-7f8ee27989ab_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c7553a85-b1d7-5800-8c41-acd80624ea68
2025-12-01 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AGZ6324/2025-11-20/image/82383630-4335-41a7-accc-e663916cc43f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117366549?view=catalogue)
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F40fa855d-edee-4715-a329-508368f3efd2.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/40fa855d-edee-4715-a329-508368f3efd2.jpg?w=600 not downloaded yet
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAGZ6324%252F2025-11-20%252Fimage%252F51b98e9a-1ced-4cce-8c82-14bd500e0a3c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AGZ6324/2025-11-20/image/51b98e9a-1ced-4cce-8c82-14bd500e0a3c_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116288981?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117547832?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116896181?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f2d6190>
2025-12-01 19:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498a6fee-1e22-5c90-919f-b3db8c1a1fee/498a6fee-1e22-5c90-919f-b3db8c1a1fee_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPMN202V%252F2025-11-06%252Fimage%252Fc1878dca-49cf-4c27-84b6-6563db073c4c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PMN202V/2025-11-06/image/c1878dca-49cf-4c27-84b6-6563db073c4c_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 498a6fee-1e22-5c90-919f-b3db8c1a1fee
2025-12-01 19:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e648fd0>
2025-12-01 19:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_affd00f4-2832-5372-b512-dce5abdf7275/affd00f4-2832-5372-b512-dce5abdf7275_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNMN170X%252F2025-11-11%252Fimage%252Fac81bfcd-8c79-4074-bf0b-4c6326c92761_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NMN170X/2025-11-11/image/ac81bfcd-8c79-4074-bf0b-4c6326c92761_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item affd00f4-2832-5372-b512-dce5abdf7275
2025-12-01 19:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e552d50>
2025-12-01 19:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM74SKU%252F2025-12-01%252Fimage%252F1ca77b06-d499-49f2-9c80-7f072067b589_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM74SKU/2025-12-01/image/1ca77b06-d499-49f2-9c80-7f072067b589_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7fd25af-1c0c-5745-a7fa-634525bcac68
2025-12-01 19:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PMN202V/2025-11-06/image/f5ad9c39-1cc5-491c-b845-ab2e80e9b6f7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116997754?view=catalogue)
2025-12-01 19:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NMN170X/2025-11-11/image/ba0ea8d0-8420-479f-9ce9-c7383af8f69c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117099385?view=catalogue)
2025-12-01 19:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM74SKU/2025-12-01/image/587dfa67-ca2c-494b-828e-c6a280ec1e9f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117631028?view=catalogue)
2025-12-01 19:01:46 [astonbarclay.gb] INFO: Found listing with ID: 116420630
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116420630%27 HTTP/1.1" 200 None
2025-12-01 19:01:46 [astonbarclay.gb] INFO: Scrape type for 116420630: 0
2025-12-01 19:01:46 [astonbarclay.gb] INFO: Found listing with ID: 117360572
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117360572%27 HTTP/1.1" 200 None
2025-12-01 19:01:46 [astonbarclay.gb] INFO: Scrape type for 117360572: 1
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM74SKU%252F2025-12-01%252Fimage%252F496a4694-5649-4221-b3cb-00663c6294a5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM74SKU/2025-12-01/image/496a4694-5649-4221-b3cb-00663c6294a5_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:46 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 60238390, 'registration': 'YS65KSU', 'account': 'ZUT001', 'make': 'VAUXHALL', 'model': 'MOKKA HATCHBACK', 'derivative': '1.4T SE 5dr', 'mileage': 74810, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2015-12-22', 'fuel': 'Petrol', 'motExpiry': '2022-01-16', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YS65KSU/2025-10-22/image/41536d8d-3ae9-4a72-ae0b-02c1bce75441_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/66a94ce6-a780-4ea9-af23-346569b3c186_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/e89c3920-3b2e-4169-aae8-b61d86f81059_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/7d6aa15b-22ac-4b3f-9732-fd4b26aea4a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/81c6137c-c0e4-48f6-81b4-438c970c7729_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/702e4ba9-c8c1-4785-8219-825aa82a60b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/36bdecec-d520-4b0c-93a0-29f204ad4f61_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/f4608216-bca5-402e-9195-8aa0fec2b3d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/395bda17-874f-40d3-a2c2-ca09cce26ae3_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1405**VOSA STATES 47K, 54K, 61K, 65K,', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': None, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:46 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 60238390, 'registration': 'YS65KSU', 'account': 'ZUT001', 'make': 'VAUXHALL', 'model': 'MOKKA HATCHBACK', 'derivative': '1.4T SE 5dr', 'mileage': 74810, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2015-12-22', 'fuel': 'Petrol', 'motExpiry': '2022-01-16', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YS65KSU/2025-10-22/image/41536d8d-3ae9-4a72-ae0b-02c1bce75441_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/66a94ce6-a780-4ea9-af23-346569b3c186_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/e89c3920-3b2e-4169-aae8-b61d86f81059_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/7d6aa15b-22ac-4b3f-9732-fd4b26aea4a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/81c6137c-c0e4-48f6-81b4-438c970c7729_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/702e4ba9-c8c1-4785-8219-825aa82a60b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/36bdecec-d520-4b0c-93a0-29f204ad4f61_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/f4608216-bca5-402e-9195-8aa0fec2b3d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/395bda17-874f-40d3-a2c2-ca09cce26ae3_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1405**VOSA STATES 47K, 54K, 61K, 65K,', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': None, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ec9234c-0d71-5d07-b7f0-d851996db0b8 with identifier: 60238390
2025-12-01 19:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ec9234c-0d71-5d07-b7f0-d851996db0b8 with scrape type 1
2025-12-01 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 8ec9234c-0d71-5d07-b7f0-d851996db0b8
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS65KSU%252F2025-10-22%252Fimage%252F41536d8d-3ae9-4a72-ae0b-02c1bce75441_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS65KSU/2025-10-22/image/41536d8d-3ae9-4a72-ae0b-02c1bce75441_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:46 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117600618, 'registration': 'YY22CCK', 'account': 'HAT002', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '40 TFSI Quattro Vorsprung 5dr S Tronic', 'mileage': 41808, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-04-27', 'fuel': 'Petrol', 'motExpiry': '2026-04-26', 'doors': 5, 'engineSize': 1984, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YY22CCK/2025-12-01/image/8653385c-446b-4de1-baa2-5bdd068c24b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/67ca57de-2c4f-4b12-8acb-b40a172efb2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/2712a7e7-aac2-47fd-9b05-722c941c767a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/f6ba50cc-03ed-4a91-a78c-c07f0c797423_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/450995cd-724b-48fd-811b-43599eb75cad_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/7ab7ca21-31fc-44f4-a6b2-8120750fbf9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/1a7bc335-d7b0-4257-9bfb-3920e9f718ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/f581f143-23e8-4bc1-a47b-9ab712f16a2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/9861ece8-b5b0-4add-9f6f-fc36dc70ed67_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**35**VOSA STATES 35K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 177, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/785ebcb1-1c27-40ce-ace3-de70523da8ee.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:46 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117600618, 'registration': 'YY22CCK', 'account': 'HAT002', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '40 TFSI Quattro Vorsprung 5dr S Tronic', 'mileage': 41808, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-04-27', 'fuel': 'Petrol', 'motExpiry': '2026-04-26', 'doors': 5, 'engineSize': 1984, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YY22CCK/2025-12-01/image/8653385c-446b-4de1-baa2-5bdd068c24b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/67ca57de-2c4f-4b12-8acb-b40a172efb2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/2712a7e7-aac2-47fd-9b05-722c941c767a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/f6ba50cc-03ed-4a91-a78c-c07f0c797423_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/450995cd-724b-48fd-811b-43599eb75cad_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/7ab7ca21-31fc-44f4-a6b2-8120750fbf9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/1a7bc335-d7b0-4257-9bfb-3920e9f718ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/f581f143-23e8-4bc1-a47b-9ab712f16a2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/9861ece8-b5b0-4add-9f6f-fc36dc70ed67_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**35**VOSA STATES 35K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 177, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/785ebcb1-1c27-40ce-ace3-de70523da8ee.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a728f23-a2e4-58e0-9257-1bf0dccb119d with identifier: 117600618
2025-12-01 19:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a728f23-a2e4-58e0-9257-1bf0dccb119d with scrape type 1
2025-12-01 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 8a728f23-a2e4-58e0-9257-1bf0dccb119d
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYY22CCK%252F2025-12-01%252Fimage%252F8653385c-446b-4de1-baa2-5bdd068c24b5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YY22CCK/2025-12-01/image/8653385c-446b-4de1-baa2-5bdd068c24b5_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:46 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117578188, 'registration': 'DV20DTX', 'account': 'THE109', 'make': 'HYUNDAI', 'model': 'I30 DIESEL TOURER', 'derivative': '1.6 CRDi SE Nav 5dr', 'mileage': 94209, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-07-27', 'fuel': 'Diesel', 'motExpiry': '2026-06-06', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 50K, 64K, 72K, 73K,', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 127, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:46 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117578188, 'registration': 'DV20DTX', 'account': 'THE109', 'make': 'HYUNDAI', 'model': 'I30 DIESEL TOURER', 'derivative': '1.6 CRDi SE Nav 5dr', 'mileage': 94209, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-07-27', 'fuel': 'Diesel', 'motExpiry': '2026-06-06', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 50K, 64K, 72K, 73K,', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 127, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c89e4dae-3812-5fcf-b511-06a26cbc4118 with identifier: 117578188
2025-12-01 19:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c89e4dae-3812-5fcf-b511-06a26cbc4118 with scrape type 1
2025-12-01 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item c89e4dae-3812-5fcf-b511-06a26cbc4118
2025-12-01 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item c89e4dae-3812-5fcf-b511-06a26cbc4118
2025-12-01 19:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c89e4dae-3812-5fcf-b511-06a26cbc4118, identifier: 117578188
2025-12-01 19:01:46 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117616509, 'registration': 'HT66VBN', 'account': 'VAN040', 'make': 'RENAULT', 'model': 'CAPTUR HATCHBACK', 'derivative': '0.9 TCE 90 Dynamique S Nav 5dr', 'mileage': 62126, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-02-20', 'fuel': 'Petrol', 'motExpiry': '2026-09-13', 'doors': 5, 'engineSize': 898, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/afff52e5-c5d5-4dc5-9156-b06b7ecba185.jpg?w=600', 'https://abimg002.imgix.net/ebc62edd-cb64-44d8-a2f8-c0b287576e00.jpg?w=600', 'https://abimg002.imgix.net/3de21a25-0c2f-4930-9d9c-1efc9d37938c.jpg?w=600', 'https://abimg002.imgix.net/1f65dd65-c576-4291-9917-28d53934a063.jpg?w=600', 'https://abimg002.imgix.net/95f30695-1ae4-4be3-b923-20e4d45d0d5d.jpg?w=600', 'https://abimg002.imgix.net/f0aaf9f1-34d5-4896-9c71-5af5f6fe92cb.jpg?w=600', 'https://abimg002.imgix.net/c8a493b3-142a-42fb-b86c-952291c4babb.jpg?w=600', 'https://abimg002.imgix.net/ff90701b-cb11-4d01-bd33-9411a417f231.jpg?w=600', 'https://abimg002.imgix.net/d3695aa3-bf2a-4c69-bfc9-d2f025f4f1c1.jpg?w=600'], 'colour': 'GREY/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': 'VOSA STATES 25K, 29K, 29K, 36K, 44K, 51K 59K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:46 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117616509, 'registration': 'HT66VBN', 'account': 'VAN040', 'make': 'RENAULT', 'model': 'CAPTUR HATCHBACK', 'derivative': '0.9 TCE 90 Dynamique S Nav 5dr', 'mileage': 62126, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-02-20', 'fuel': 'Petrol', 'motExpiry': '2026-09-13', 'doors': 5, 'engineSize': 898, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/afff52e5-c5d5-4dc5-9156-b06b7ecba185.jpg?w=600', 'https://abimg002.imgix.net/ebc62edd-cb64-44d8-a2f8-c0b287576e00.jpg?w=600', 'https://abimg002.imgix.net/3de21a25-0c2f-4930-9d9c-1efc9d37938c.jpg?w=600', 'https://abimg002.imgix.net/1f65dd65-c576-4291-9917-28d53934a063.jpg?w=600', 'https://abimg002.imgix.net/95f30695-1ae4-4be3-b923-20e4d45d0d5d.jpg?w=600', 'https://abimg002.imgix.net/f0aaf9f1-34d5-4896-9c71-5af5f6fe92cb.jpg?w=600', 'https://abimg002.imgix.net/c8a493b3-142a-42fb-b86c-952291c4babb.jpg?w=600', 'https://abimg002.imgix.net/ff90701b-cb11-4d01-bd33-9411a417f231.jpg?w=600', 'https://abimg002.imgix.net/d3695aa3-bf2a-4c69-bfc9-d2f025f4f1c1.jpg?w=600'], 'colour': 'GREY/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': 'VOSA STATES 25K, 29K, 29K, 36K, 44K, 51K 59K,', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2baa3a6-d796-5fe7-92d1-862ebf3d40ce with identifier: 117616509
2025-12-01 19:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2baa3a6-d796-5fe7-92d1-862ebf3d40ce with scrape type 1
2025-12-01 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item c2baa3a6-d796-5fe7-92d1-862ebf3d40ce
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fafff52e5-c5d5-4dc5-9156-b06b7ecba185.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/afff52e5-c5d5-4dc5-9156-b06b7ecba185.jpg?w=600 not downloaded yet
2025-12-01 19:01:46 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117547822, 'registration': 'SY18NPD', 'account': 'THE109', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.1 Zetec 3dr', 'mileage': 88304, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-03-23', 'fuel': 'Petrol', 'motExpiry': '2026-03-25', 'doors': 3, 'engineSize': 1084, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 27K, 35K, 49K, 63K, 80K,', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 101, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:46 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117547822, 'registration': 'SY18NPD', 'account': 'THE109', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.1 Zetec 3dr', 'mileage': 88304, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-03-23', 'fuel': 'Petrol', 'motExpiry': '2026-03-25', 'doors': 3, 'engineSize': 1084, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 27K, 35K, 49K, 63K, 80K,', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 101, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36d5976d-aee7-5109-be55-181e24e3bb9e with identifier: 117547822
2025-12-01 19:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36d5976d-aee7-5109-be55-181e24e3bb9e with scrape type 1
2025-12-01 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 36d5976d-aee7-5109-be55-181e24e3bb9e
2025-12-01 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 36d5976d-aee7-5109-be55-181e24e3bb9e
2025-12-01 19:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 36d5976d-aee7-5109-be55-181e24e3bb9e, identifier: 117547822
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fabe328a8-429f-4c12-ad80-e4e148c48679.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/abe328a8-429f-4c12-ad80-e4e148c48679.jpg?w=600 not downloaded yet
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAGZ6324%252F2025-11-20%252Fimage%252F38e90add-4c25-423d-8f23-4d4c55296da8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AGZ6324/2025-11-20/image/38e90add-4c25-423d-8f23-4d4c55296da8_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c89e4dae-3812-5fcf-b511-06a26cbc4118 with identifier: 117578188
2025-12-01 19:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c89e4dae-3812-5fcf-b511-06a26cbc4118 with identifier: 117578188
2025-12-01 19:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 151614 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151614
2025-12-01 19:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c89e4dae-3812-5fcf-b511-06a26cbc4118 spider: astonbarclay.gb
2025-12-01 19:01:46 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: c89e4dae-3812-5fcf-b511-06a26cbc4118 due to rule: high_mileage_for_country.json, error: 151614 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151614
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'c89e4dae-3812-5fcf-b511-06a26cbc4118',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DV20DTX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117578188',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'HYUNDAI',
 'model': 'I30 DIESEL TOURER',
 'odometer': 94209,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-27',
 'seller_name': 'TCB Group - Prime',
 'title': 'HYUNDAI I30 DIESEL TOURER 1.6 CRDi SE Nav 5dr',
 'transmission': 'manual',
 'trim': '1.6 CRDi SE Nav 5dr',
 'vin': None,
 'year': 2020}
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117578188%27 HTTP/1.1" 200 None
2025-12-01 19:01:46 [astonbarclay.gb] INFO: Saving data for 117578188: {'created_time': 1764615706.786266, 'last_price_update_time': 1764615706.786275, 'auction_closing_time': 1765285200.0}
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117578188') HTTP/1.1" 204 0
2025-12-01 19:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 36d5976d-aee7-5109-be55-181e24e3bb9e with identifier: 117547822
2025-12-01 19:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 36d5976d-aee7-5109-be55-181e24e3bb9e with identifier: 117547822
2025-12-01 19:01:46 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 36d5976d-aee7-5109-be55-181e24e3bb9e with identifier: 117547822 to the API
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2736d5976d-aee7-5109-be55-181e24e3bb9e%27 HTTP/1.1" 200 None
2025-12-01 19:01:47 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 36d5976d-aee7-5109-be55-181e24e3bb9e: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:01:46 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117547822?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.1L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '36d5976d-aee7-5109-be55-181e24e3bb9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SY18NPD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117547822',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'FORD',
 'model': 'FIESTA HATCHBACK',
 'odometer': 88304,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-23',
 'seller_name': 'TCB Group - Prime',
 'title': 'FORD FIESTA HATCHBACK 1.1 Zetec 3dr',
 'transmission': 'manual',
 'trim': '1.1 Zetec 3dr',
 'vin': None,
 'year': 2018}
2025-12-01 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547822%27 HTTP/1.1" 200 None
2025-12-01 19:01:47 [astonbarclay.gb] INFO: Saving data for 117547822: {'created_time': 1764615707.10179, 'last_price_update_time': 1764615707.1018, 'auction_closing_time': 1765285200.0}
2025-12-01 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117547822') HTTP/1.1" 204 0
2025-12-01 19:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e81db10>
2025-12-01 19:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_affd00f4-2832-5372-b512-dce5abdf7275/affd00f4-2832-5372-b512-dce5abdf7275_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNMN170X%252F2025-11-11%252Fimage%252F45ced919-696c-4e83-88ba-f21bb72ca49a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NMN170X/2025-11-11/image/45ced919-696c-4e83-88ba-f21bb72ca49a_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item affd00f4-2832-5372-b512-dce5abdf7275
2025-12-01 19:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f215d10>
2025-12-01 19:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498a6fee-1e22-5c90-919f-b3db8c1a1fee/498a6fee-1e22-5c90-919f-b3db8c1a1fee_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPMN202V%252F2025-11-06%252Fimage%252F2d168458-ec89-4e83-9133-176e41a70955_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PMN202V/2025-11-06/image/2d168458-ec89-4e83-9133-176e41a70955_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 498a6fee-1e22-5c90-919f-b3db8c1a1fee
2025-12-01 19:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e8e90d0>
2025-12-01 19:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM74SKU%252F2025-12-01%252Fimage%252F988bb02b-b1e1-4657-a0d7-52cce11f65ee_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM74SKU/2025-12-01/image/988bb02b-b1e1-4657-a0d7-52cce11f65ee_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7fd25af-1c0c-5745-a7fa-634525bcac68
2025-12-01 19:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NMN170X/2025-11-11/image/b4dd87c0-4f27-4d5f-830d-54edde2109fb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117099385?view=catalogue)
2025-12-01 19:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AGZ6324/2025-11-20/image/c4816a9a-bec7-4018-aa0e-12a4af35d00e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117366549?view=catalogue)
2025-12-01 19:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM74SKU/2025-12-01/image/8890e246-99e3-455b-bba6-a2f679994482_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117631028?view=catalogue)
2025-12-01 19:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/322fb60e-126d-4a01-a866-9bc740d566ab.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117613099?view=catalogue)
2025-12-01 19:01:48 [astonbarclay.gb] INFO: Found listing with ID: 117492820
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117492820%27 HTTP/1.1" 200 None
2025-12-01 19:01:48 [astonbarclay.gb] INFO: Scrape type for 117492820: 1
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM74SKU%252F2025-12-01%252Fimage%252Fc9ae33f4-eb6f-46f9-b3dc-22283d870fc2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM74SKU/2025-12-01/image/c9ae33f4-eb6f-46f9-b3dc-22283d870fc2_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS65KSU%252F2025-10-22%252Fimage%252F66a94ce6-a780-4ea9-af23-346569b3c186_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS65KSU/2025-10-22/image/66a94ce6-a780-4ea9-af23-346569b3c186_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYY22CCK%252F2025-12-01%252Fimage%252F67ca57de-2c4f-4b12-8acb-b40a172efb2a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YY22CCK/2025-12-01/image/67ca57de-2c4f-4b12-8acb-b40a172efb2a_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Febc62edd-cb64-44d8-a2f8-c0b287576e00.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/ebc62edd-cb64-44d8-a2f8-c0b287576e00.jpg?w=600 not downloaded yet
2025-12-01 19:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f2c3e90>
2025-12-01 19:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1d41c3-9a55-5035-95b3-78f2642f8712/8d1d41c3-9a55-5035-95b3-78f2642f8712_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAGZ6324%252F2025-11-20%252Fimage%252F82383630-4335-41a7-accc-e663916cc43f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AGZ6324/2025-11-20/image/82383630-4335-41a7-accc-e663916cc43f_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8d1d41c3-9a55-5035-95b3-78f2642f8712
2025-12-01 19:01:48 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116288981, 'registration': 'GK17LHL', 'account': 'ZUT001', 'make': 'NISSAN', 'model': 'QASHQAI DIESEL HATCHBACK', 'derivative': '1.6 dCi Tekna 5dr Xtronic', 'mileage': 88060, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-03-11', 'fuel': 'Diesel', 'motExpiry': '2026-04-27', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GK17LHL/2025-10-14/image/681955bc-daf4-499b-869f-a31e01033809_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/b0ab792c-80b6-45e4-bf7e-5c2e65c76e8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/b2522cad-e936-469b-8465-cc454e6e210e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/ccab1513-0561-4d33-86f5-0dc2d1ccc9ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/a110cd1b-3dba-4af0-9264-9bf7688d62ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/9b0f9adc-2807-4720-bdaa-81cf105c406d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/d3df424d-39b1-4909-ad2b-e100b16fd096_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/14bea6ed-7b1f-4dc7-a9f8-447f4375d7a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/27af64a2-00ef-4418-bdfc-297f7617e5fb_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 02/18 - 20K, 05/19 - 35K, 03/20 - 41K, 04/21 - 47K, 04/22 - 57K, 03/23 - 66K, 04/25 - 84K', 'remarks': '**1682** VOSA STATES 41K, 47K, 57K, 66K, 75K, 84K SD CARD', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:48 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116288981, 'registration': 'GK17LHL', 'account': 'ZUT001', 'make': 'NISSAN', 'model': 'QASHQAI DIESEL HATCHBACK', 'derivative': '1.6 dCi Tekna 5dr Xtronic', 'mileage': 88060, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-03-11', 'fuel': 'Diesel', 'motExpiry': '2026-04-27', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GK17LHL/2025-10-14/image/681955bc-daf4-499b-869f-a31e01033809_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/b0ab792c-80b6-45e4-bf7e-5c2e65c76e8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/b2522cad-e936-469b-8465-cc454e6e210e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/ccab1513-0561-4d33-86f5-0dc2d1ccc9ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/a110cd1b-3dba-4af0-9264-9bf7688d62ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/9b0f9adc-2807-4720-bdaa-81cf105c406d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/d3df424d-39b1-4909-ad2b-e100b16fd096_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/14bea6ed-7b1f-4dc7-a9f8-447f4375d7a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/27af64a2-00ef-4418-bdfc-297f7617e5fb_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 02/18 - 20K, 05/19 - 35K, 03/20 - 41K, 04/21 - 47K, 04/22 - 57K, 03/23 - 66K, 04/25 - 84K', 'remarks': '**1682** VOSA STATES 41K, 47K, 57K, 66K, 75K, 84K SD CARD', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2 with identifier: 116288981
2025-12-01 19:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2 with scrape type 1
2025-12-01 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGK17LHL%252F2025-10-14%252Fimage%252F681955bc-daf4-499b-869f-a31e01033809_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK17LHL/2025-10-14/image/681955bc-daf4-499b-869f-a31e01033809_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:48 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117547832, 'registration': 'NX66XEO', 'account': 'THE109', 'make': 'FORD', 'model': 'MONDEO DIESEL HATCHBACK', 'derivative': '1.5 TDCi ECOnetic Zetec 5dr', 'mileage': 104815, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-09-16', 'fuel': 'Diesel', 'motExpiry': '2026-04-18', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 31K, 44K, 50K, 62K, 68K, 87K, 99K,', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 94, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:48 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117547832, 'registration': 'NX66XEO', 'account': 'THE109', 'make': 'FORD', 'model': 'MONDEO DIESEL HATCHBACK', 'derivative': '1.5 TDCi ECOnetic Zetec 5dr', 'mileage': 104815, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-09-16', 'fuel': 'Diesel', 'motExpiry': '2026-04-18', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 31K, 44K, 50K, 62K, 68K, 87K, 99K,', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 94, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 606c334b-f187-5ad5-ba9c-a24bff686768 with identifier: 117547832
2025-12-01 19:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 606c334b-f187-5ad5-ba9c-a24bff686768 with scrape type 1
2025-12-01 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 606c334b-f187-5ad5-ba9c-a24bff686768
2025-12-01 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 606c334b-f187-5ad5-ba9c-a24bff686768
2025-12-01 19:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 606c334b-f187-5ad5-ba9c-a24bff686768, identifier: 117547832
2025-12-01 19:01:48 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116896181, 'registration': 'YH69SSU', 'account': 'MOT075', 'make': 'BMW', 'model': '3 SERIES SALOON', 'derivative': '320i M Sport 4dr Step Auto', 'mileage': 77769, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-09-25', 'fuel': 'Petrol', 'motExpiry': '2025-09-24', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/YH69SSU/2025-11-04/image/fd2edd8b-dd83-46d9-b464-9f0a5c693656_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/65b6d811-35ad-40e6-aea7-31c56c9ceb1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/0fe1740a-82ba-4b2e-ac79-7c195b965e98_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/a6487a49-4772-4dc0-b987-e330222c7783_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/d2cb10cf-df3c-4121-b38a-992cb57e46e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/c80458b0-ef1d-4166-abad-27f40c91ec54_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/5ac82db8-8f2a-47cf-9114-f76306116e4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/4fa116c2-3797-42f9-ae6b-165f25c84975_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/600cdb0b-5ff4-49bc-ab2e-98fe51409907_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/dc68151f-40d7-49ff-a5d7-c2f0e35a80c9_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1854**VOSA STATES 64K, 69K, 75K, OUTSTANDING RECALL', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4a5e0543-30a5-4179-93f4-aca81a06534c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:48 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116896181, 'registration': 'YH69SSU', 'account': 'MOT075', 'make': 'BMW', 'model': '3 SERIES SALOON', 'derivative': '320i M Sport 4dr Step Auto', 'mileage': 77769, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 322}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-09-25', 'fuel': 'Petrol', 'motExpiry': '2025-09-24', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/YH69SSU/2025-11-04/image/fd2edd8b-dd83-46d9-b464-9f0a5c693656_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/65b6d811-35ad-40e6-aea7-31c56c9ceb1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/0fe1740a-82ba-4b2e-ac79-7c195b965e98_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/a6487a49-4772-4dc0-b987-e330222c7783_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/d2cb10cf-df3c-4121-b38a-992cb57e46e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/c80458b0-ef1d-4166-abad-27f40c91ec54_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/5ac82db8-8f2a-47cf-9114-f76306116e4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/4fa116c2-3797-42f9-ae6b-165f25c84975_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/600cdb0b-5ff4-49bc-ab2e-98fe51409907_removebg.jpg?w=600', 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/dc68151f-40d7-49ff-a5d7-c2f0e35a80c9_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1854**VOSA STATES 64K, 69K, 75K, OUTSTANDING RECALL', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4a5e0543-30a5-4179-93f4-aca81a06534c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b1f2c7b-e136-5e43-b530-d9601a71ebf7 with identifier: 116896181
2025-12-01 19:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b1f2c7b-e136-5e43-b530-d9601a71ebf7 with scrape type 1
2025-12-01 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4b1f2c7b-e136-5e43-b530-d9601a71ebf7
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYH69SSU%252F2025-11-04%252Fimage%252Ffd2edd8b-dd83-46d9-b464-9f0a5c693656_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH69SSU/2025-11-04/image/fd2edd8b-dd83-46d9-b464-9f0a5c693656_removebg.jpg?w=600 already downloaded
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYH69SSU%252F2025-11-04%252Fimage%252F65b6d811-35ad-40e6-aea7-31c56c9ceb1a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH69SSU/2025-11-04/image/65b6d811-35ad-40e6-aea7-31c56c9ceb1a_removebg.jpg?w=600 already downloaded
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYH69SSU%252F2025-11-04%252Fimage%252F0fe1740a-82ba-4b2e-ac79-7c195b965e98_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH69SSU/2025-11-04/image/0fe1740a-82ba-4b2e-ac79-7c195b965e98_removebg.jpg?w=600 already downloaded
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYH69SSU%252F2025-11-04%252Fimage%252Fa6487a49-4772-4dc0-b987-e330222c7783_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH69SSU/2025-11-04/image/a6487a49-4772-4dc0-b987-e330222c7783_removebg.jpg?w=600 already downloaded
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYH69SSU%252F2025-11-04%252Fimage%252Fd2cb10cf-df3c-4121-b38a-992cb57e46e4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH69SSU/2025-11-04/image/d2cb10cf-df3c-4121-b38a-992cb57e46e4_removebg.jpg?w=600 already downloaded
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYH69SSU%252F2025-11-04%252Fimage%252Fc80458b0-ef1d-4166-abad-27f40c91ec54_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH69SSU/2025-11-04/image/c80458b0-ef1d-4166-abad-27f40c91ec54_removebg.jpg?w=600 already downloaded
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYH69SSU%252F2025-11-04%252Fimage%252F5ac82db8-8f2a-47cf-9114-f76306116e4b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH69SSU/2025-11-04/image/5ac82db8-8f2a-47cf-9114-f76306116e4b_removebg.jpg?w=600 already downloaded
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYH69SSU%252F2025-11-04%252Fimage%252F4fa116c2-3797-42f9-ae6b-165f25c84975_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH69SSU/2025-11-04/image/4fa116c2-3797-42f9-ae6b-165f25c84975_removebg.jpg?w=600 already downloaded
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYH69SSU%252F2025-11-04%252Fimage%252F600cdb0b-5ff4-49bc-ab2e-98fe51409907_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH69SSU/2025-11-04/image/600cdb0b-5ff4-49bc-ab2e-98fe51409907_removebg.jpg?w=600 already downloaded
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYH69SSU%252F2025-11-04%252Fimage%252Fdc68151f-40d7-49ff-a5d7-c2f0e35a80c9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YH69SSU/2025-11-04/image/dc68151f-40d7-49ff-a5d7-c2f0e35a80c9_removebg.jpg?w=600 already downloaded
2025-12-01 19:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4b1f2c7b-e136-5e43-b530-d9601a71ebf7, identifier: 116896181
2025-12-01 19:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AGZ6324/2025-11-20/image/32fb6d3b-f9f0-4692-9be9-cc39a5c3ed36_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117366549?view=catalogue)
2025-12-01 19:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PMN202V/2025-11-06/image/f977f8b0-f990-496a-8c97-91797d37ffc6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116997754?view=catalogue)
2025-12-01 19:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/c207063b-b49b-46dd-8a34-9869f84ae358.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117610728?view=catalogue)
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F328bf1f9-5cfb-446e-b07d-5962f453a871.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/328bf1f9-5cfb-446e-b07d-5962f453a871.jpg?w=600 not downloaded yet
2025-12-01 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAGZ6324%252F2025-11-20%252Fimage%252F677c4639-db7f-4981-b0cd-1eace3bbaf49_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AGZ6324/2025-11-20/image/677c4639-db7f-4981-b0cd-1eace3bbaf49_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 606c334b-f187-5ad5-ba9c-a24bff686768 with identifier: 117547832
2025-12-01 19:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 606c334b-f187-5ad5-ba9c-a24bff686768 with identifier: 117547832
2025-12-01 19:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 168682 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168682
2025-12-01 19:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 606c334b-f187-5ad5-ba9c-a24bff686768 spider: astonbarclay.gb
2025-12-01 19:01:49 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 606c334b-f187-5ad5-ba9c-a24bff686768 due to rule: high_mileage_for_country.json, error: 168682 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168682
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '606c334b-f187-5ad5-ba9c-a24bff686768',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NX66XEO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117547832',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'FORD',
 'model': 'MONDEO DIESEL HATCHBACK',
 'odometer': 104815,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-16',
 'seller_name': 'TCB Group - Prime',
 'title': 'FORD MONDEO DIESEL HATCHBACK 1.5 TDCi ECOnetic Zetec 5dr',
 'transmission': 'manual',
 'trim': '1.5 TDCi ECOnetic Zetec 5dr',
 'vin': None,
 'year': 2016}
2025-12-01 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547832%27 HTTP/1.1" 200 None
2025-12-01 19:01:49 [astonbarclay.gb] INFO: Saving data for 117547832: {'created_time': 1764615709.214798, 'last_price_update_time': 1764615709.214808, 'auction_closing_time': 1765285200.0}
2025-12-01 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117547832') HTTP/1.1" 204 0
2025-12-01 19:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4b1f2c7b-e136-5e43-b530-d9601a71ebf7 with identifier: 116896181
2025-12-01 19:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4b1f2c7b-e136-5e43-b530-d9601a71ebf7 with identifier: 116896181
2025-12-01 19:01:49 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4b1f2c7b-e136-5e43-b530-d9601a71ebf7 with identifier: 116896181 to the API
2025-12-01 19:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:01:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:01:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116896181?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4b1f2c7b-e136-5e43-b530-d9601a71ebf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YH69SSU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116896181',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'BMW',
 'model': '3 SERIES SALOON',
 'odometer': 77769,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photo_urls': ['https://abimg003.imgix.net/YH69SSU/2025-11-04/image/fd2edd8b-dd83-46d9-b464-9f0a5c693656_removebg.jpg?w=600',
                'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/65b6d811-35ad-40e6-aea7-31c56c9ceb1a_removebg.jpg?w=600',
                'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/0fe1740a-82ba-4b2e-ac79-7c195b965e98_removebg.jpg?w=600',
                'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/a6487a49-4772-4dc0-b987-e330222c7783_removebg.jpg?w=600',
                'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/d2cb10cf-df3c-4121-b38a-992cb57e46e4_removebg.jpg?w=600',
                'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/c80458b0-ef1d-4166-abad-27f40c91ec54_removebg.jpg?w=600',
                'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/5ac82db8-8f2a-47cf-9114-f76306116e4b_removebg.jpg?w=600',
                'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/4fa116c2-3797-42f9-ae6b-165f25c84975_removebg.jpg?w=600',
                'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/600cdb0b-5ff4-49bc-ab2e-98fe51409907_removebg.jpg?w=600',
                'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/dc68151f-40d7-49ff-a5d7-c2f0e35a80c9_removebg.jpg?w=600'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1f2c7b-e136-5e43-b530-d9601a71ebf7/4b1f2c7b-e136-5e43-b530-d9601a71ebf7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22232,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/fd2edd8b-dd83-46d9-b464-9f0a5c693656_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1f2c7b-e136-5e43-b530-d9601a71ebf7/4b1f2c7b-e136-5e43-b530-d9601a71ebf7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 20537,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/65b6d811-35ad-40e6-aea7-31c56c9ceb1a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1f2c7b-e136-5e43-b530-d9601a71ebf7/4b1f2c7b-e136-5e43-b530-d9601a71ebf7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24376,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/0fe1740a-82ba-4b2e-ac79-7c195b965e98_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1f2c7b-e136-5e43-b530-d9601a71ebf7/4b1f2c7b-e136-5e43-b530-d9601a71ebf7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23103,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/a6487a49-4772-4dc0-b987-e330222c7783_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1f2c7b-e136-5e43-b530-d9601a71ebf7/4b1f2c7b-e136-5e43-b530-d9601a71ebf7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42412,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/d2cb10cf-df3c-4121-b38a-992cb57e46e4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1f2c7b-e136-5e43-b530-d9601a71ebf7/4b1f2c7b-e136-5e43-b530-d9601a71ebf7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34723,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/c80458b0-ef1d-4166-abad-27f40c91ec54_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1f2c7b-e136-5e43-b530-d9601a71ebf7/4b1f2c7b-e136-5e43-b530-d9601a71ebf7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56629,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/5ac82db8-8f2a-47cf-9114-f76306116e4b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1f2c7b-e136-5e43-b530-d9601a71ebf7/4b1f2c7b-e136-5e43-b530-d9601a71ebf7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39790,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/4fa116c2-3797-42f9-ae6b-165f25c84975_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1f2c7b-e136-5e43-b530-d9601a71ebf7/4b1f2c7b-e136-5e43-b530-d9601a71ebf7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38797,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/600cdb0b-5ff4-49bc-ab2e-98fe51409907_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b1f2c7b-e136-5e43-b530-d9601a71ebf7/4b1f2c7b-e136-5e43-b530-d9601a71ebf7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40502,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YH69SSU/2025-11-04/image/dc68151f-40d7-49ff-a5d7-c2f0e35a80c9_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-25',
 'seller_name': 'MotoNovo Finance',
 'title': 'BMW 3 SERIES SALOON 320i M Sport 4dr Step Auto',
 'transmission': 'automatic',
 'trim': '320i M Sport 4dr Step Auto',
 'vin': None,
 'year': 2019}
2025-12-01 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116896181%27 HTTP/1.1" 200 None
2025-12-01 19:01:49 [astonbarclay.gb] INFO: Saving data for 116896181: {'created_time': 1764615709.566441, 'last_price_update_time': 1764615709.566455, 'auction_closing_time': 1765285200.0}
2025-12-01 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116896181') HTTP/1.1" 204 0
2025-12-01 19:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e671990>
2025-12-01 19:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498a6fee-1e22-5c90-919f-b3db8c1a1fee/498a6fee-1e22-5c90-919f-b3db8c1a1fee_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPMN202V%252F2025-11-06%252Fimage%252Ff5ad9c39-1cc5-491c-b845-ab2e80e9b6f7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PMN202V/2025-11-06/image/f5ad9c39-1cc5-491c-b845-ab2e80e9b6f7_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 498a6fee-1e22-5c90-919f-b3db8c1a1fee
2025-12-01 19:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e5287d0>
2025-12-01 19:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_affd00f4-2832-5372-b512-dce5abdf7275/affd00f4-2832-5372-b512-dce5abdf7275_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNMN170X%252F2025-11-11%252Fimage%252Fba0ea8d0-8420-479f-9ce9-c7383af8f69c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NMN170X/2025-11-11/image/ba0ea8d0-8420-479f-9ce9-c7383af8f69c_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item affd00f4-2832-5372-b512-dce5abdf7275
2025-12-01 19:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e7db990>
2025-12-01 19:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM74SKU%252F2025-12-01%252Fimage%252F587dfa67-ca2c-494b-828e-c6a280ec1e9f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM74SKU/2025-12-01/image/587dfa67-ca2c-494b-828e-c6a280ec1e9f_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7fd25af-1c0c-5745-a7fa-634525bcac68
2025-12-01 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/NMN170X/2025-11-11/image/59610efb-1fa3-4ff1-a171-2348499bc6e1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117099385?view=catalogue)
2025-12-01 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PMN202V/2025-11-06/image/d7bb92e4-8f27-4797-a918-51ff41be9dd3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116997754?view=catalogue)
2025-12-01 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/287e56cf-7f7b-49e4-a42a-db3aae2172ea.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117613099?view=catalogue)
2025-12-01 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM74SKU/2025-12-01/image/e4e81195-fdef-41a2-9e68-635f3ef09faf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117631028?view=catalogue)
2025-12-01 19:01:50 [astonbarclay.gb] INFO: Found listing with ID: 117460295
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117460295%27 HTTP/1.1" 200 None
2025-12-01 19:01:50 [astonbarclay.gb] INFO: Scrape type for 117460295: 0
2025-12-01 19:01:50 [astonbarclay.gb] INFO: Found listing with ID: 117625956
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117625956%27 HTTP/1.1" 200 None
2025-12-01 19:01:50 [astonbarclay.gb] INFO: Scrape type for 117625956: 1
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM74SKU%252F2025-12-01%252Fimage%252F882a1277-8154-4c61-ac9b-05ebbfb39dab_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM74SKU/2025-12-01/image/882a1277-8154-4c61-ac9b-05ebbfb39dab_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS65KSU%252F2025-10-22%252Fimage%252Fe89c3920-3b2e-4169-aae8-b61d86f81059_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS65KSU/2025-10-22/image/e89c3920-3b2e-4169-aae8-b61d86f81059_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYY22CCK%252F2025-12-01%252Fimage%252F2712a7e7-aac2-47fd-9b05-722c941c767a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YY22CCK/2025-12-01/image/2712a7e7-aac2-47fd-9b05-722c941c767a_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F3de21a25-0c2f-4930-9d9c-1efc9d37938c.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/3de21a25-0c2f-4930-9d9c-1efc9d37938c.jpg?w=600 not downloaded yet
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGK17LHL%252F2025-10-14%252Fimage%252Fb0ab792c-80b6-45e4-bf7e-5c2e65c76e8e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK17LHL/2025-10-14/image/b0ab792c-80b6-45e4-bf7e-5c2e65c76e8e_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/5978d2fc-d80a-4fb9-b6c2-3eba4b955fd7.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117610728?view=catalogue)
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fa09ffd85-aa9c-4794-a662-3a2a796086de.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/a09ffd85-aa9c-4794-a662-3a2a796086de.jpg?w=600 not downloaded yet
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAGZ6324%252F2025-11-20%252Fimage%252F1e157848-7440-412b-ba3f-c616f234cca1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AGZ6324/2025-11-20/image/1e157848-7440-412b-ba3f-c616f234cca1_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e862690>
2025-12-01 19:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_affd00f4-2832-5372-b512-dce5abdf7275/affd00f4-2832-5372-b512-dce5abdf7275_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNMN170X%252F2025-11-11%252Fimage%252Fb4dd87c0-4f27-4d5f-830d-54edde2109fb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NMN170X/2025-11-11/image/b4dd87c0-4f27-4d5f-830d-54edde2109fb_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item affd00f4-2832-5372-b512-dce5abdf7275
2025-12-01 19:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e683810>
2025-12-01 19:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1d41c3-9a55-5035-95b3-78f2642f8712/8d1d41c3-9a55-5035-95b3-78f2642f8712_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAGZ6324%252F2025-11-20%252Fimage%252Fc4816a9a-bec7-4018-aa0e-12a4af35d00e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AGZ6324/2025-11-20/image/c4816a9a-bec7-4018-aa0e-12a4af35d00e_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8d1d41c3-9a55-5035-95b3-78f2642f8712
2025-12-01 19:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5064705110>
2025-12-01 19:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM74SKU%252F2025-12-01%252Fimage%252F8890e246-99e3-455b-bba6-a2f679994482_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM74SKU/2025-12-01/image/8890e246-99e3-455b-bba6-a2f679994482_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a7fd25af-1c0c-5745-a7fa-634525bcac68
2025-12-01 19:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e8313d0>
2025-12-01 19:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d743ca24-9736-56bb-8379-98c4ba2e7cf2/d743ca24-9736-56bb-8379-98c4ba2e7cf2_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F322fb60e-126d-4a01-a866-9bc740d566ab.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/322fb60e-126d-4a01-a866-9bc740d566ab.jpg?w=600 saved to cache
2025-12-01 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d743ca24-9736-56bb-8379-98c4ba2e7cf2
2025-12-01 19:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YY22CCK/2025-12-01/image/8653385c-446b-4de1-baa2-5bdd068c24b5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117600618?view=catalogue)
2025-12-01 19:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/afff52e5-c5d5-4dc5-9156-b06b7ecba185.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616509?view=catalogue)
2025-12-01 19:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS65KSU/2025-10-22/image/41536d8d-3ae9-4a72-ae0b-02c1bce75441_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/60238390?view=catalogue)
2025-12-01 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 117550264
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550264%27 HTTP/1.1" 200 None
2025-12-01 19:01:51 [astonbarclay.gb] INFO: Scrape type for 117550264: 0
2025-12-01 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 116504950
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116504950%27 HTTP/1.1" 200 None
2025-12-01 19:01:51 [astonbarclay.gb] INFO: Scrape type for 116504950: 0
2025-12-01 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 116645477
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116645477%27 HTTP/1.1" 200 None
2025-12-01 19:01:51 [astonbarclay.gb] INFO: Scrape type for 116645477: 0
2025-12-01 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 116013920
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116013920%27 HTTP/1.1" 200 None
2025-12-01 19:01:51 [astonbarclay.gb] INFO: Scrape type for 116013920: 0
2025-12-01 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 117591412
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117591412%27 HTTP/1.1" 200 None
2025-12-01 19:01:51 [astonbarclay.gb] INFO: Scrape type for 117591412: 0
2025-12-01 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 117601597
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117601597%27 HTTP/1.1" 200 None
2025-12-01 19:01:51 [astonbarclay.gb] INFO: Scrape type for 117601597: 0
2025-12-01 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 117599669
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599669%27 HTTP/1.1" 200 None
2025-12-01 19:01:51 [astonbarclay.gb] INFO: Scrape type for 117599669: 0
2025-12-01 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 117598315
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117598315%27 HTTP/1.1" 200 None
2025-12-01 19:01:51 [astonbarclay.gb] INFO: Scrape type for 117598315: 0
2025-12-01 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 117599419
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599419%27 HTTP/1.1" 200 None
2025-12-01 19:01:51 [astonbarclay.gb] INFO: Scrape type for 117599419: 0
2025-12-01 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 117570357
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570357%27 HTTP/1.1" 200 None
2025-12-01 19:01:51 [astonbarclay.gb] INFO: Scrape type for 117570357: 0
2025-12-01 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 115990741
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115990741%27 HTTP/1.1" 200 None
2025-12-01 19:01:51 [astonbarclay.gb] INFO: Scrape type for 115990741: 0
2025-12-01 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 117406754
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117406754%27 HTTP/1.1" 200 None
2025-12-01 19:01:51 [astonbarclay.gb] INFO: Scrape type for 117406754: 1
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS65KSU%252F2025-10-22%252Fimage%252F7d6aa15b-22ac-4b3f-9732-fd4b26aea4a5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS65KSU/2025-10-22/image/7d6aa15b-22ac-4b3f-9732-fd4b26aea4a5_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYY22CCK%252F2025-12-01%252Fimage%252Ff6ba50cc-03ed-4a91-a78c-c07f0c797423_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YY22CCK/2025-12-01/image/f6ba50cc-03ed-4a91-a78c-c07f0c797423_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F1f65dd65-c576-4291-9917-28d53934a063.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/1f65dd65-c576-4291-9917-28d53934a063.jpg?w=600 not downloaded yet
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGK17LHL%252F2025-10-14%252Fimage%252Fb2522cad-e936-469b-8465-cc454e6e210e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK17LHL/2025-10-14/image/b2522cad-e936-469b-8465-cc454e6e210e_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e8b2090>
2025-12-01 19:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1d41c3-9a55-5035-95b3-78f2642f8712/8d1d41c3-9a55-5035-95b3-78f2642f8712_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAGZ6324%252F2025-11-20%252Fimage%252F32fb6d3b-f9f0-4692-9be9-cc39a5c3ed36_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AGZ6324/2025-11-20/image/32fb6d3b-f9f0-4692-9be9-cc39a5c3ed36_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8d1d41c3-9a55-5035-95b3-78f2642f8712
2025-12-01 19:01:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e710490>
2025-12-01 19:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498a6fee-1e22-5c90-919f-b3db8c1a1fee/498a6fee-1e22-5c90-919f-b3db8c1a1fee_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPMN202V%252F2025-11-06%252Fimage%252Ff977f8b0-f990-496a-8c97-91797d37ffc6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PMN202V/2025-11-06/image/f977f8b0-f990-496a-8c97-91797d37ffc6_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 498a6fee-1e22-5c90-919f-b3db8c1a1fee
2025-12-01 19:01:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e803310>
2025-12-01 19:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4471d1-1330-5f18-bc6b-f50165d7cebc/9b4471d1-1330-5f18-bc6b-f50165d7cebc_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fc207063b-b49b-46dd-8a34-9869f84ae358.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/c207063b-b49b-46dd-8a34-9869f84ae358.jpg?w=600 saved to cache
2025-12-01 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b4471d1-1330-5f18-bc6b-f50165d7cebc
2025-12-01 19:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AGZ6324/2025-11-20/image/38e90add-4c25-423d-8f23-4d4c55296da8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117366549?view=catalogue)
2025-12-01 19:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM74SKU/2025-12-01/image/496a4694-5649-4221-b3cb-00663c6294a5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117631028?view=catalogue)
2025-12-01 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Feb66f7d8-e6e2-4fbc-9292-1f064c93c791.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/eb66f7d8-e6e2-4fbc-9292-1f064c93c791.jpg?w=600 not downloaded yet
2025-12-01 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAGZ6324%252F2025-11-20%252Fimage%252F4c4b08ca-f6e7-4fc6-9f40-7f0695d05a60_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AGZ6324/2025-11-20/image/4c4b08ca-f6e7-4fc6-9f40-7f0695d05a60_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e5294d0>
2025-12-01 19:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_affd00f4-2832-5372-b512-dce5abdf7275/affd00f4-2832-5372-b512-dce5abdf7275_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FNMN170X%252F2025-11-11%252Fimage%252F59610efb-1fa3-4ff1-a171-2348499bc6e1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/NMN170X/2025-11-11/image/59610efb-1fa3-4ff1-a171-2348499bc6e1_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item affd00f4-2832-5372-b512-dce5abdf7275
2025-12-01 19:01:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: affd00f4-2832-5372-b512-dce5abdf7275, skipping ID generation
2025-12-01 19:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item affd00f4-2832-5372-b512-dce5abdf7275 with scrape type 1
2025-12-01 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item affd00f4-2832-5372-b512-dce5abdf7275 from tracking dictionaries
2025-12-01 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item affd00f4-2832-5372-b512-dce5abdf7275 sending to next pipeline
2025-12-01 19:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: affd00f4-2832-5372-b512-dce5abdf7275, identifier: 117099385
2025-12-01 19:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f214f10>
2025-12-01 19:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498a6fee-1e22-5c90-919f-b3db8c1a1fee/498a6fee-1e22-5c90-919f-b3db8c1a1fee_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPMN202V%252F2025-11-06%252Fimage%252Fd7bb92e4-8f27-4797-a918-51ff41be9dd3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PMN202V/2025-11-06/image/d7bb92e4-8f27-4797-a918-51ff41be9dd3_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 498a6fee-1e22-5c90-919f-b3db8c1a1fee
2025-12-01 19:01:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 498a6fee-1e22-5c90-919f-b3db8c1a1fee, skipping ID generation
2025-12-01 19:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 498a6fee-1e22-5c90-919f-b3db8c1a1fee with scrape type 1
2025-12-01 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 498a6fee-1e22-5c90-919f-b3db8c1a1fee from tracking dictionaries
2025-12-01 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 498a6fee-1e22-5c90-919f-b3db8c1a1fee sending to next pipeline
2025-12-01 19:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 498a6fee-1e22-5c90-919f-b3db8c1a1fee, identifier: 116997754
2025-12-01 19:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e71ec50>
2025-12-01 19:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d743ca24-9736-56bb-8379-98c4ba2e7cf2/d743ca24-9736-56bb-8379-98c4ba2e7cf2_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F287e56cf-7f7b-49e4-a42a-db3aae2172ea.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/287e56cf-7f7b-49e4-a42a-db3aae2172ea.jpg?w=600 saved to cache
2025-12-01 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d743ca24-9736-56bb-8379-98c4ba2e7cf2
2025-12-01 19:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e97a150>
2025-12-01 19:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM74SKU%252F2025-12-01%252Fimage%252Fe4e81195-fdef-41a2-9e68-635f3ef09faf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM74SKU/2025-12-01/image/e4e81195-fdef-41a2-9e68-635f3ef09faf_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a7fd25af-1c0c-5745-a7fa-634525bcac68
2025-12-01 19:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GK17LHL/2025-10-14/image/681955bc-daf4-499b-869f-a31e01033809_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116288981?view=catalogue)
2025-12-01 19:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS65KSU/2025-10-22/image/66a94ce6-a780-4ea9-af23-346569b3c186_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/60238390?view=catalogue)
2025-12-01 19:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YY22CCK/2025-12-01/image/67ca57de-2c4f-4b12-8acb-b40a172efb2a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117600618?view=catalogue)
2025-12-01 19:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/ebc62edd-cb64-44d8-a2f8-c0b287576e00.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616509?view=catalogue)
2025-12-01 19:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/abe328a8-429f-4c12-ad80-e4e148c48679.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117610728?view=catalogue)
2025-12-01 19:01:54 [astonbarclay.gb] INFO: Found listing with ID: 116500039
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116500039%27 HTTP/1.1" 200 None
2025-12-01 19:01:54 [astonbarclay.gb] INFO: Scrape type for 116500039: 0
2025-12-01 19:01:54 [astonbarclay.gb] INFO: Found listing with ID: 115302250
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115302250%27 HTTP/1.1" 200 None
2025-12-01 19:01:54 [astonbarclay.gb] INFO: Scrape type for 115302250: 0
2025-12-01 19:01:54 [astonbarclay.gb] INFO: Found listing with ID: 117547683
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547683%27 HTTP/1.1" 200 None
2025-12-01 19:01:54 [astonbarclay.gb] INFO: Scrape type for 117547683: 0
2025-12-01 19:01:54 [astonbarclay.gb] INFO: Found listing with ID: 117394487
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117394487%27 HTTP/1.1" 200 None
2025-12-01 19:01:54 [astonbarclay.gb] INFO: Scrape type for 117394487: 1
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS65KSU%252F2025-10-22%252Fimage%252F81c6137c-c0e4-48f6-81b4-438c970c7729_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS65KSU/2025-10-22/image/81c6137c-c0e4-48f6-81b4-438c970c7729_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYY22CCK%252F2025-12-01%252Fimage%252F450995cd-724b-48fd-811b-43599eb75cad_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YY22CCK/2025-12-01/image/450995cd-724b-48fd-811b-43599eb75cad_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F95f30695-1ae4-4be3-b923-20e4d45d0d5d.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/95f30695-1ae4-4be3-b923-20e4d45d0d5d.jpg?w=600 not downloaded yet
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGK17LHL%252F2025-10-14%252Fimage%252Fccab1513-0561-4d33-86f5-0dc2d1ccc9ec_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK17LHL/2025-10-14/image/ccab1513-0561-4d33-86f5-0dc2d1ccc9ec_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117080670?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117185008?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117023136?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117416921?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: affd00f4-2832-5372-b512-dce5abdf7275 with identifier: 117099385
2025-12-01 19:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: affd00f4-2832-5372-b512-dce5abdf7275 with identifier: 117099385
2025-12-01 19:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'

Failed validating 'type' in schema['properties']['color']:
    {'minLength': 1, 'type': 'string'}

On instance['color']:
    None
2025-12-01 19:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: affd00f4-2832-5372-b512-dce5abdf7275 spider: astonbarclay.gb
2025-12-01 19:01:54 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: affd00f4-2832-5372-b512-dce5abdf7275 due to rule: missing_color.json, error: None is not of type 'string'

Failed validating 'type' in schema['properties']['color']:
    {'minLength': 1, 'type': 'string'}

On instance['color']:
    None
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': None,
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': None,
 'engine': '',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': 'affd00f4-2832-5372-b512-dce5abdf7275',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NMN170X',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117099385',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS HATCHBACK',
 'odometer': 24960,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_affd00f4-2832-5372-b512-dce5abdf7275/affd00f4-2832-5372-b512-dce5abdf7275_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27400,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/cc4aa83c-ec05-4c40-b921-5acf5a4d607e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_affd00f4-2832-5372-b512-dce5abdf7275/affd00f4-2832-5372-b512-dce5abdf7275_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27419,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/d25140bf-37eb-452a-8d00-218d72db8d72_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_affd00f4-2832-5372-b512-dce5abdf7275/affd00f4-2832-5372-b512-dce5abdf7275_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29704,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/1d5bc75a-2ae4-42c1-aa24-990f771ada9c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_affd00f4-2832-5372-b512-dce5abdf7275/affd00f4-2832-5372-b512-dce5abdf7275_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28947,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/024c4b16-7aa6-4e47-8df8-be8725f063f9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_affd00f4-2832-5372-b512-dce5abdf7275/affd00f4-2832-5372-b512-dce5abdf7275_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57580,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/ac81bfcd-8c79-4074-bf0b-4c6326c92761_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_affd00f4-2832-5372-b512-dce5abdf7275/affd00f4-2832-5372-b512-dce5abdf7275_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55464,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/45ced919-696c-4e83-88ba-f21bb72ca49a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_affd00f4-2832-5372-b512-dce5abdf7275/affd00f4-2832-5372-b512-dce5abdf7275_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49387,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/ba0ea8d0-8420-479f-9ce9-c7383af8f69c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_affd00f4-2832-5372-b512-dce5abdf7275/affd00f4-2832-5372-b512-dce5abdf7275_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55651,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/b4dd87c0-4f27-4d5f-830d-54edde2109fb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_affd00f4-2832-5372-b512-dce5abdf7275/affd00f4-2832-5372-b512-dce5abdf7275_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55038,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/NMN170X/2025-11-11/image/59610efb-1fa3-4ff1-a171-2348499bc6e1_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-12',
 'seller_name': 'Motability Operations',
 'title': 'MERCEDES-BENZ A CLASS HATCHBACK A180 Sport 5dr',
 'transmission': 'manual',
 'trim': 'A180 Sport 5dr',
 'vin': None,
 'year': 2019}
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117099385%27 HTTP/1.1" 200 None
2025-12-01 19:01:54 [astonbarclay.gb] INFO: Saving data for 117099385: {'created_time': 1764615714.768508, 'last_price_update_time': 1764615714.768519, 'auction_closing_time': 1765275300.0}
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117099385') HTTP/1.1" 204 0
2025-12-01 19:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 498a6fee-1e22-5c90-919f-b3db8c1a1fee with identifier: 116997754
2025-12-01 19:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 498a6fee-1e22-5c90-919f-b3db8c1a1fee with identifier: 116997754
2025-12-01 19:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'

Failed validating 'type' in schema['properties']['color']:
    {'minLength': 1, 'type': 'string'}

On instance['color']:
    None
2025-12-01 19:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: 498a6fee-1e22-5c90-919f-b3db8c1a1fee spider: astonbarclay.gb
2025-12-01 19:01:55 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 498a6fee-1e22-5c90-919f-b3db8c1a1fee due to rule: missing_color.json, error: None is not of type 'string'

Failed validating 'type' in schema['properties']['color']:
    {'minLength': 1, 'type': 'string'}

On instance['color']:
    None
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': None,
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': None,
 'engine': '',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': '498a6fee-1e22-5c90-919f-b3db8c1a1fee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PMN202V',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116997754',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'RENAULT',
 'model': 'CAPTUR HATCHBACK',
 'odometer': 32634,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498a6fee-1e22-5c90-919f-b3db8c1a1fee/498a6fee-1e22-5c90-919f-b3db8c1a1fee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31342,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/f97d2254-1b9f-4735-a8ee-c695253d65f3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498a6fee-1e22-5c90-919f-b3db8c1a1fee/498a6fee-1e22-5c90-919f-b3db8c1a1fee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35591,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/1e4e2a67-6936-45b0-a38f-82b2eaf5e37a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498a6fee-1e22-5c90-919f-b3db8c1a1fee/498a6fee-1e22-5c90-919f-b3db8c1a1fee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29922,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/8ea2c304-2809-49ac-9e6a-855eb478d2e6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498a6fee-1e22-5c90-919f-b3db8c1a1fee/498a6fee-1e22-5c90-919f-b3db8c1a1fee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30712,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/519d201f-a070-4799-bd55-5138dac9854e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498a6fee-1e22-5c90-919f-b3db8c1a1fee/498a6fee-1e22-5c90-919f-b3db8c1a1fee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51068,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/c1878dca-49cf-4c27-84b6-6563db073c4c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498a6fee-1e22-5c90-919f-b3db8c1a1fee/498a6fee-1e22-5c90-919f-b3db8c1a1fee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44305,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/2d168458-ec89-4e83-9133-176e41a70955_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498a6fee-1e22-5c90-919f-b3db8c1a1fee/498a6fee-1e22-5c90-919f-b3db8c1a1fee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61620,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/f5ad9c39-1cc5-491c-b845-ab2e80e9b6f7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498a6fee-1e22-5c90-919f-b3db8c1a1fee/498a6fee-1e22-5c90-919f-b3db8c1a1fee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66076,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/f977f8b0-f990-496a-8c97-91797d37ffc6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498a6fee-1e22-5c90-919f-b3db8c1a1fee/498a6fee-1e22-5c90-919f-b3db8c1a1fee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57056,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PMN202V/2025-11-06/image/d7bb92e4-8f27-4797-a918-51ff41be9dd3_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-19',
 'seller_name': 'Motability Operations',
 'title': 'RENAULT CAPTUR HATCHBACK 1.3 TCE 140 Iconic Edition 5dr',
 'transmission': 'manual',
 'trim': '1.3 TCE 140 Iconic Edition 5dr',
 'vin': None,
 'year': 2022}
2025-12-01 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116997754%27 HTTP/1.1" 200 None
2025-12-01 19:01:55 [astonbarclay.gb] INFO: Saving data for 116997754: {'created_time': 1764615715.082647, 'last_price_update_time': 1764615715.082658, 'auction_closing_time': 1765275300.0}
2025-12-01 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116997754') HTTP/1.1" 204 0
2025-12-01 19:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f2aba10>
2025-12-01 19:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-01 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4471d1-1330-5f18-bc6b-f50165d7cebc/9b4471d1-1330-5f18-bc6b-f50165d7cebc_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F5978d2fc-d80a-4fb9-b6c2-3eba4b955fd7.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/5978d2fc-d80a-4fb9-b6c2-3eba4b955fd7.jpg?w=600 saved to cache
2025-12-01 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b4471d1-1330-5f18-bc6b-f50165d7cebc
2025-12-01 19:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AGZ6324/2025-11-20/image/677c4639-db7f-4981-b0cd-1eace3bbaf49_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117366549?view=catalogue)
2025-12-01 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F650216a1-c723-4e6d-94d7-f75a778e1e9f.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/650216a1-c723-4e6d-94d7-f75a778e1e9f.jpg?w=600 not downloaded yet
2025-12-01 19:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e9a9550>
2025-12-01 19:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a728f23-a2e4-58e0-9257-1bf0dccb119d/8a728f23-a2e4-58e0-9257-1bf0dccb119d_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYY22CCK%252F2025-12-01%252Fimage%252F8653385c-446b-4de1-baa2-5bdd068c24b5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YY22CCK/2025-12-01/image/8653385c-446b-4de1-baa2-5bdd068c24b5_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8a728f23-a2e4-58e0-9257-1bf0dccb119d
2025-12-01 19:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e703f10>
2025-12-01 19:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2baa3a6-d796-5fe7-92d1-862ebf3d40ce/c2baa3a6-d796-5fe7-92d1-862ebf3d40ce_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fafff52e5-c5d5-4dc5-9156-b06b7ecba185.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/afff52e5-c5d5-4dc5-9156-b06b7ecba185.jpg?w=600 saved to cache
2025-12-01 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c2baa3a6-d796-5fe7-92d1-862ebf3d40ce
2025-12-01 19:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e71fb10>
2025-12-01 19:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ec9234c-0d71-5d07-b7f0-d851996db0b8/8ec9234c-0d71-5d07-b7f0-d851996db0b8_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS65KSU%252F2025-10-22%252Fimage%252F41536d8d-3ae9-4a72-ae0b-02c1bce75441_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS65KSU/2025-10-22/image/41536d8d-3ae9-4a72-ae0b-02c1bce75441_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ec9234c-0d71-5d07-b7f0-d851996db0b8
2025-12-01 19:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GK17LHL/2025-10-14/image/b0ab792c-80b6-45e4-bf7e-5c2e65c76e8e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116288981?view=catalogue)
2025-12-01 19:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YY22CCK/2025-12-01/image/2712a7e7-aac2-47fd-9b05-722c941c767a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117600618?view=catalogue)
2025-12-01 19:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/3de21a25-0c2f-4930-9d9c-1efc9d37938c.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616509?view=catalogue)
2025-12-01 19:01:56 [astonbarclay.gb] INFO: Found listing with ID: 116557093
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116557093%27 HTTP/1.1" 200 None
2025-12-01 19:01:56 [astonbarclay.gb] INFO: Scrape type for 116557093: 0
2025-12-01 19:01:56 [astonbarclay.gb] INFO: Found listing with ID: 117086159
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117086159%27 HTTP/1.1" 200 None
2025-12-01 19:01:56 [astonbarclay.gb] INFO: Scrape type for 117086159: 1
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS65KSU%252F2025-10-22%252Fimage%252F702e4ba9-c8c1-4785-8219-825aa82a60b1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS65KSU/2025-10-22/image/702e4ba9-c8c1-4785-8219-825aa82a60b1_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYY22CCK%252F2025-12-01%252Fimage%252F7ab7ca21-31fc-44f4-a6b2-8120750fbf9f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YY22CCK/2025-12-01/image/7ab7ca21-31fc-44f4-a6b2-8120750fbf9f_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Ff0aaf9f1-34d5-4896-9c71-5af5f6fe92cb.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/f0aaf9f1-34d5-4896-9c71-5af5f6fe92cb.jpg?w=600 not downloaded yet
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGK17LHL%252F2025-10-14%252Fimage%252Fa110cd1b-3dba-4af0-9264-9bf7688d62ed_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK17LHL/2025-10-14/image/a110cd1b-3dba-4af0-9264-9bf7688d62ed_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e5c8710>
2025-12-01 19:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1d41c3-9a55-5035-95b3-78f2642f8712/8d1d41c3-9a55-5035-95b3-78f2642f8712_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAGZ6324%252F2025-11-20%252Fimage%252F38e90add-4c25-423d-8f23-4d4c55296da8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AGZ6324/2025-11-20/image/38e90add-4c25-423d-8f23-4d4c55296da8_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8d1d41c3-9a55-5035-95b3-78f2642f8712
2025-12-01 19:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e5d8290>
2025-12-01 19:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM74SKU%252F2025-12-01%252Fimage%252F496a4694-5649-4221-b3cb-00663c6294a5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM74SKU/2025-12-01/image/496a4694-5649-4221-b3cb-00663c6294a5_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a7fd25af-1c0c-5745-a7fa-634525bcac68
2025-12-01 19:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AGZ6324/2025-11-20/image/1e157848-7440-412b-ba3f-c616f234cca1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117366549?view=catalogue)
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fe68f76e3-5134-4041-abe5-4fef8c59ae05.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/e68f76e3-5134-4041-abe5-4fef8c59ae05.jpg?w=600 not downloaded yet
2025-12-01 19:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f379f90>
2025-12-01 19:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-01 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2/1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGK17LHL%252F2025-10-14%252Fimage%252F681955bc-daf4-499b-869f-a31e01033809_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK17LHL/2025-10-14/image/681955bc-daf4-499b-869f-a31e01033809_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2
2025-12-01 19:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f2cc7d0>
2025-12-01 19:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ec9234c-0d71-5d07-b7f0-d851996db0b8/8ec9234c-0d71-5d07-b7f0-d851996db0b8_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS65KSU%252F2025-10-22%252Fimage%252F66a94ce6-a780-4ea9-af23-346569b3c186_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS65KSU/2025-10-22/image/66a94ce6-a780-4ea9-af23-346569b3c186_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8ec9234c-0d71-5d07-b7f0-d851996db0b8
2025-12-01 19:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e64fad0>
2025-12-01 19:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a728f23-a2e4-58e0-9257-1bf0dccb119d/8a728f23-a2e4-58e0-9257-1bf0dccb119d_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYY22CCK%252F2025-12-01%252Fimage%252F67ca57de-2c4f-4b12-8acb-b40a172efb2a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YY22CCK/2025-12-01/image/67ca57de-2c4f-4b12-8acb-b40a172efb2a_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8a728f23-a2e4-58e0-9257-1bf0dccb119d
2025-12-01 19:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e55fad0>
2025-12-01 19:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2baa3a6-d796-5fe7-92d1-862ebf3d40ce/c2baa3a6-d796-5fe7-92d1-862ebf3d40ce_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Febc62edd-cb64-44d8-a2f8-c0b287576e00.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/ebc62edd-cb64-44d8-a2f8-c0b287576e00.jpg?w=600 saved to cache
2025-12-01 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c2baa3a6-d796-5fe7-92d1-862ebf3d40ce
2025-12-01 19:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e5713d0>
2025-12-01 19:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4471d1-1330-5f18-bc6b-f50165d7cebc/9b4471d1-1330-5f18-bc6b-f50165d7cebc_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fabe328a8-429f-4c12-ad80-e4e148c48679.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/abe328a8-429f-4c12-ad80-e4e148c48679.jpg?w=600 saved to cache
2025-12-01 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b4471d1-1330-5f18-bc6b-f50165d7cebc
2025-12-01 19:01:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117080670, 'registration': 'LX73WOH', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'POLO HATCHBACK', 'derivative': '1.0 TSI R-Line 5dr', 'mileage': 24778, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-09-22', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LX73WOH/2025-11-12/image/b6a7fa27-0937-4ff3-8d91-e4b2bb5130d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/6be52a8c-6c4e-4b01-baf7-ffe57b26864f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/776351df-9ca4-451e-b0c9-d49c1a035615_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/297cf991-9b8e-4ec8-855d-da5f4de84bfb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/a2788cd7-85ad-4861-b146-c6dd9637c0ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/1aa2008d-b6f7-4728-a5aa-2bac1d7a31a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/1cf49a13-1c13-45ef-b1ce-5a8a7c1a5708_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/eb300b4c-adb3-4a28-a652-603e10241439_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/c4a878bd-782c-42f0-91ba-2574458510a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/eb864b5a-6a54-4e10-a564-f6303ceacd1a_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 08/25 22k', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3aa67c8c-5f8d-43ff-944f-5cdbd18333aa.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117080670, 'registration': 'LX73WOH', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'POLO HATCHBACK', 'derivative': '1.0 TSI R-Line 5dr', 'mileage': 24778, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-09-22', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LX73WOH/2025-11-12/image/b6a7fa27-0937-4ff3-8d91-e4b2bb5130d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/6be52a8c-6c4e-4b01-baf7-ffe57b26864f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/776351df-9ca4-451e-b0c9-d49c1a035615_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/297cf991-9b8e-4ec8-855d-da5f4de84bfb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/a2788cd7-85ad-4861-b146-c6dd9637c0ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/1aa2008d-b6f7-4728-a5aa-2bac1d7a31a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/1cf49a13-1c13-45ef-b1ce-5a8a7c1a5708_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/eb300b4c-adb3-4a28-a652-603e10241439_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/c4a878bd-782c-42f0-91ba-2574458510a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/eb864b5a-6a54-4e10-a564-f6303ceacd1a_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 08/25 22k', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3aa67c8c-5f8d-43ff-944f-5cdbd18333aa.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1a8361b-a960-5c0c-86a5-26eec748d1ec with identifier: 117080670
2025-12-01 19:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1a8361b-a960-5c0c-86a5-26eec748d1ec with scrape type 1
2025-12-01 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a1a8361b-a960-5c0c-86a5-26eec748d1ec
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX73WOH%252F2025-11-12%252Fimage%252Fb6a7fa27-0937-4ff3-8d91-e4b2bb5130d4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX73WOH/2025-11-12/image/b6a7fa27-0937-4ff3-8d91-e4b2bb5130d4_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117185008, 'registration': 'AP23VKB', 'account': 'MOT070', 'make': 'AUDI', 'model': 'A3 SPORTBACK', 'derivative': '30 TFSI S Line 5dr', 'mileage': 33982, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AP23VKB/2025-11-25/image/4028a888-6714-4fe7-8672-1bfb808745ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/5a35829f-1fac-48a5-9644-d6b708c9dacf_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/a476a35b-c2c9-4f1d-b573-70ed1785a53b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/73b8cc7a-bea7-4a20-b83b-06d3cb3603e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/6827af7d-8ef4-40a8-83ab-6c1644cb8ac4_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/40f55a5d-86b6-46c9-b3ed-6aa2fb02781e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/b2fd1c98-6d01-4cfd-abb7-8fe2365fc477_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/4c7837b0-f5ad-4a33-b31a-c23f0903389c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/6704290f-a77a-4d02-81e4-97488e185212_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/24 14k - 02/25 21k', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 132, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6959bb19-d6ce-4cf6-bc6d-30f98c98347b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117185008, 'registration': 'AP23VKB', 'account': 'MOT070', 'make': 'AUDI', 'model': 'A3 SPORTBACK', 'derivative': '30 TFSI S Line 5dr', 'mileage': 33982, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AP23VKB/2025-11-25/image/4028a888-6714-4fe7-8672-1bfb808745ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/5a35829f-1fac-48a5-9644-d6b708c9dacf_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/a476a35b-c2c9-4f1d-b573-70ed1785a53b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/73b8cc7a-bea7-4a20-b83b-06d3cb3603e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/6827af7d-8ef4-40a8-83ab-6c1644cb8ac4_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/40f55a5d-86b6-46c9-b3ed-6aa2fb02781e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/b2fd1c98-6d01-4cfd-abb7-8fe2365fc477_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/4c7837b0-f5ad-4a33-b31a-c23f0903389c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/6704290f-a77a-4d02-81e4-97488e185212_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/24 14k - 02/25 21k', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 132, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6959bb19-d6ce-4cf6-bc6d-30f98c98347b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bc2920f-55ca-53ab-84a8-db2242b7bc17 with identifier: 117185008
2025-12-01 19:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bc2920f-55ca-53ab-84a8-db2242b7bc17 with scrape type 1
2025-12-01 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 4bc2920f-55ca-53ab-84a8-db2242b7bc17
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAP23VKB%252F2025-11-25%252Fimage%252F4028a888-6714-4fe7-8672-1bfb808745ee_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP23VKB/2025-11-25/image/4028a888-6714-4fe7-8672-1bfb808745ee_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117023136, 'registration': 'LY74DXW', 'account': 'MOT070', 'make': 'JEEP', 'model': 'AVENGER HATCHBACK', 'derivative': '1.2 e-Hybrid Summit 5dr DCT', 'mileage': 2143, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-02-12', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LY74DXW/2025-11-10/image/df9ad979-7c37-4b10-92f0-fe7e54c7045c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/ec2f2cf0-02c5-4798-90dc-ab567ad265db_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/56739470-ba08-4f64-985d-cec7b10b6ed0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/4977023c-527b-4d14-9124-770879b828a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/53d10d18-a2e9-4433-9d71-d104163cd4c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/ce74b827-ea4f-4c56-965e-aa8d2f11a5f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/6cfe5c9f-f441-42a1-8969-c3b953eefa2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/e5867b0b-c2c6-4b63-8993-f59574ebccd2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/eca87a04-82a3-4493-87ff-0fe616ed978e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ad9d285a-09c0-4ef1-a29f-1cd99517e26e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117023136, 'registration': 'LY74DXW', 'account': 'MOT070', 'make': 'JEEP', 'model': 'AVENGER HATCHBACK', 'derivative': '1.2 e-Hybrid Summit 5dr DCT', 'mileage': 2143, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-02-12', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LY74DXW/2025-11-10/image/df9ad979-7c37-4b10-92f0-fe7e54c7045c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/ec2f2cf0-02c5-4798-90dc-ab567ad265db_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/56739470-ba08-4f64-985d-cec7b10b6ed0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/4977023c-527b-4d14-9124-770879b828a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/53d10d18-a2e9-4433-9d71-d104163cd4c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/ce74b827-ea4f-4c56-965e-aa8d2f11a5f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/6cfe5c9f-f441-42a1-8969-c3b953eefa2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/e5867b0b-c2c6-4b63-8993-f59574ebccd2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/eca87a04-82a3-4493-87ff-0fe616ed978e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ad9d285a-09c0-4ef1-a29f-1cd99517e26e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc3d0ce7-7a35-5a36-9894-7cc131d3a49b with identifier: 117023136
2025-12-01 19:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc3d0ce7-7a35-5a36-9894-7cc131d3a49b with scrape type 1
2025-12-01 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item cc3d0ce7-7a35-5a36-9894-7cc131d3a49b
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLY74DXW%252F2025-11-10%252Fimage%252Fdf9ad979-7c37-4b10-92f0-fe7e54c7045c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74DXW/2025-11-10/image/df9ad979-7c37-4b10-92f0-fe7e54c7045c_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117416921, 'registration': 'LV24VUY', 'account': 'MOT070', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '35 TFSI S Line 5dr S Tronic', 'mileage': 18895, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-04-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LV24VUY/2025-11-25/image/354b23e8-7435-4583-a6e5-98f7080e99b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/412e036c-b41a-4409-8ff2-15242e796bd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/47bf93eb-86e5-4b1e-b422-c6ab74baf2f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/e918fe75-fb1b-41c3-b0ae-de85303bd5b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/d7fe0ebe-602a-47d4-881b-f5a911f9ab25_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/5568309f-8fd9-46c9-a927-68d10a3f2907_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/bdf87b18-11d9-46f6-afdb-9207355da6d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/aebf380c-8ebc-48aa-9974-792df1c3fe47_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/93ffa6d6-6b37-4cb5-8851-bec80ec86d7d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/85578af9-2326-4236-8167-acb0c0b1acd5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117416921, 'registration': 'LV24VUY', 'account': 'MOT070', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '35 TFSI S Line 5dr S Tronic', 'mileage': 18895, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-04-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LV24VUY/2025-11-25/image/354b23e8-7435-4583-a6e5-98f7080e99b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/412e036c-b41a-4409-8ff2-15242e796bd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/47bf93eb-86e5-4b1e-b422-c6ab74baf2f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/e918fe75-fb1b-41c3-b0ae-de85303bd5b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/d7fe0ebe-602a-47d4-881b-f5a911f9ab25_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/5568309f-8fd9-46c9-a927-68d10a3f2907_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/bdf87b18-11d9-46f6-afdb-9207355da6d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/aebf380c-8ebc-48aa-9974-792df1c3fe47_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/93ffa6d6-6b37-4cb5-8851-bec80ec86d7d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/85578af9-2326-4236-8167-acb0c0b1acd5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6071c6b2-0f41-5f72-90bd-eb2c31a3d527 with identifier: 117416921
2025-12-01 19:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6071c6b2-0f41-5f72-90bd-eb2c31a3d527 with scrape type 1
2025-12-01 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 6071c6b2-0f41-5f72-90bd-eb2c31a3d527
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV24VUY%252F2025-11-25%252Fimage%252F354b23e8-7435-4583-a6e5-98f7080e99b9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24VUY/2025-11-25/image/354b23e8-7435-4583-a6e5-98f7080e99b9_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GK17LHL/2025-10-14/image/b2522cad-e936-469b-8465-cc454e6e210e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116288981?view=catalogue)
2025-12-01 19:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS65KSU/2025-10-22/image/7d6aa15b-22ac-4b3f-9732-fd4b26aea4a5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/60238390?view=catalogue)
2025-12-01 19:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YY22CCK/2025-12-01/image/f6ba50cc-03ed-4a91-a78c-c07f0c797423_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117600618?view=catalogue)
2025-12-01 19:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/1f65dd65-c576-4291-9917-28d53934a063.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616509?view=catalogue)
2025-12-01 19:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/a09ffd85-aa9c-4794-a662-3a2a796086de.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117610728?view=catalogue)
2025-12-01 19:01:58 [astonbarclay.gb] INFO: Found listing with ID: 117395964
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117395964%27 HTTP/1.1" 200 None
2025-12-01 19:01:58 [astonbarclay.gb] INFO: Scrape type for 117395964: 1
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS65KSU%252F2025-10-22%252Fimage%252F36bdecec-d520-4b0c-93a0-29f204ad4f61_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS65KSU/2025-10-22/image/36bdecec-d520-4b0c-93a0-29f204ad4f61_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYY22CCK%252F2025-12-01%252Fimage%252F1a7bc335-d7b0-4257-9bfb-3920e9f718ae_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YY22CCK/2025-12-01/image/1a7bc335-d7b0-4257-9bfb-3920e9f718ae_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fc8a493b3-142a-42fb-b86c-952291c4babb.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/c8a493b3-142a-42fb-b86c-952291c4babb.jpg?w=600 not downloaded yet
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGK17LHL%252F2025-10-14%252Fimage%252F9b0f9adc-2807-4720-bdaa-81cf105c406d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK17LHL/2025-10-14/image/9b0f9adc-2807-4720-bdaa-81cf105c406d_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f50646d9250>
2025-12-01 19:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1d41c3-9a55-5035-95b3-78f2642f8712/8d1d41c3-9a55-5035-95b3-78f2642f8712_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAGZ6324%252F2025-11-20%252Fimage%252F677c4639-db7f-4981-b0cd-1eace3bbaf49_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AGZ6324/2025-11-20/image/677c4639-db7f-4981-b0cd-1eace3bbaf49_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8d1d41c3-9a55-5035-95b3-78f2642f8712
2025-12-01 19:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AGZ6324/2025-11-20/image/4c4b08ca-f6e7-4fc6-9f40-7f0695d05a60_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117366549?view=catalogue)
2025-12-01 19:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS65KSU/2025-10-22/image/e89c3920-3b2e-4169-aae8-b61d86f81059_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/60238390?view=catalogue)
2025-12-01 19:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM74SKU/2025-12-01/image/882a1277-8154-4c61-ac9b-05ebbfb39dab_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117631028?view=catalogue)
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fcdccb1ad-e1d6-4201-aa56-dac4693cb326.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/cdccb1ad-e1d6-4201-aa56-dac4693cb326.jpg?w=600 not downloaded yet
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX73WOH%252F2025-11-12%252Fimage%252F6be52a8c-6c4e-4b01-baf7-ffe57b26864f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX73WOH/2025-11-12/image/6be52a8c-6c4e-4b01-baf7-ffe57b26864f_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAP23VKB%252F2025-11-25%252Fimage%252F5a35829f-1fac-48a5-9644-d6b708c9dacf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP23VKB/2025-11-25/image/5a35829f-1fac-48a5-9644-d6b708c9dacf_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLY74DXW%252F2025-11-10%252Fimage%252Fec2f2cf0-02c5-4798-90dc-ab567ad265db_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74DXW/2025-11-10/image/ec2f2cf0-02c5-4798-90dc-ab567ad265db_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV24VUY%252F2025-11-25%252Fimage%252F412e036c-b41a-4409-8ff2-15242e796bd8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24VUY/2025-11-25/image/412e036c-b41a-4409-8ff2-15242e796bd8_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f22f990>
2025-12-01 19:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2/1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGK17LHL%252F2025-10-14%252Fimage%252Fb0ab792c-80b6-45e4-bf7e-5c2e65c76e8e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK17LHL/2025-10-14/image/b0ab792c-80b6-45e4-bf7e-5c2e65c76e8e_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2
2025-12-01 19:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e67f550>
2025-12-01 19:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a728f23-a2e4-58e0-9257-1bf0dccb119d/8a728f23-a2e4-58e0-9257-1bf0dccb119d_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYY22CCK%252F2025-12-01%252Fimage%252F2712a7e7-aac2-47fd-9b05-722c941c767a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YY22CCK/2025-12-01/image/2712a7e7-aac2-47fd-9b05-722c941c767a_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8a728f23-a2e4-58e0-9257-1bf0dccb119d
2025-12-01 19:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e539050>
2025-12-01 19:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2baa3a6-d796-5fe7-92d1-862ebf3d40ce/c2baa3a6-d796-5fe7-92d1-862ebf3d40ce_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F3de21a25-0c2f-4930-9d9c-1efc9d37938c.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/3de21a25-0c2f-4930-9d9c-1efc9d37938c.jpg?w=600 saved to cache
2025-12-01 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c2baa3a6-d796-5fe7-92d1-862ebf3d40ce
2025-12-01 19:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GK17LHL/2025-10-14/image/ccab1513-0561-4d33-86f5-0dc2d1ccc9ec_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116288981?view=catalogue)
2025-12-01 19:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YY22CCK/2025-12-01/image/450995cd-724b-48fd-811b-43599eb75cad_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117600618?view=catalogue)
2025-12-01 19:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/95f30695-1ae4-4be3-b923-20e4d45d0d5d.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616509?view=catalogue)
2025-12-01 19:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/eb66f7d8-e6e2-4fbc-9292-1f064c93c791.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117610728?view=catalogue)
2025-12-01 19:01:59 [astonbarclay.gb] INFO: Found listing with ID: 117627785
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117627785%27 HTTP/1.1" 200 None
2025-12-01 19:01:59 [astonbarclay.gb] INFO: Scrape type for 117627785: 1
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS65KSU%252F2025-10-22%252Fimage%252Ff4608216-bca5-402e-9195-8aa0fec2b3d5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS65KSU/2025-10-22/image/f4608216-bca5-402e-9195-8aa0fec2b3d5_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYY22CCK%252F2025-12-01%252Fimage%252Ff581f143-23e8-4bc1-a47b-9ab712f16a2a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YY22CCK/2025-12-01/image/f581f143-23e8-4bc1-a47b-9ab712f16a2a_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fff90701b-cb11-4d01-bd33-9411a417f231.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/ff90701b-cb11-4d01-bd33-9411a417f231.jpg?w=600 not downloaded yet
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGK17LHL%252F2025-10-14%252Fimage%252Fd3df424d-39b1-4909-ad2b-e100b16fd096_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK17LHL/2025-10-14/image/d3df424d-39b1-4909-ad2b-e100b16fd096_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e636d50>
2025-12-01 19:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1d41c3-9a55-5035-95b3-78f2642f8712/8d1d41c3-9a55-5035-95b3-78f2642f8712_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAGZ6324%252F2025-11-20%252Fimage%252F1e157848-7440-412b-ba3f-c616f234cca1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AGZ6324/2025-11-20/image/1e157848-7440-412b-ba3f-c616f234cca1_removebg.jpg?w=600 saved to cache
2025-12-01 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8d1d41c3-9a55-5035-95b3-78f2642f8712
2025-12-01 19:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/650216a1-c723-4e6d-94d7-f75a778e1e9f.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117610728?view=catalogue)
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX73WOH%252F2025-11-12%252Fimage%252F776351df-9ca4-451e-b0c9-d49c1a035615_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX73WOH/2025-11-12/image/776351df-9ca4-451e-b0c9-d49c1a035615_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAP23VKB%252F2025-11-25%252Fimage%252Fa476a35b-c2c9-4f1d-b573-70ed1785a53b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP23VKB/2025-11-25/image/a476a35b-c2c9-4f1d-b573-70ed1785a53b_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLY74DXW%252F2025-11-10%252Fimage%252F56739470-ba08-4f64-985d-cec7b10b6ed0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74DXW/2025-11-10/image/56739470-ba08-4f64-985d-cec7b10b6ed0_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV24VUY%252F2025-11-25%252Fimage%252F47bf93eb-86e5-4b1e-b422-c6ab74baf2f1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24VUY/2025-11-25/image/47bf93eb-86e5-4b1e-b422-c6ab74baf2f1_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e8b2850>
2025-12-01 19:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2/1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGK17LHL%252F2025-10-14%252Fimage%252Fb2522cad-e936-469b-8465-cc454e6e210e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK17LHL/2025-10-14/image/b2522cad-e936-469b-8465-cc454e6e210e_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2
2025-12-01 19:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e52a710>
2025-12-01 19:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ec9234c-0d71-5d07-b7f0-d851996db0b8/8ec9234c-0d71-5d07-b7f0-d851996db0b8_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS65KSU%252F2025-10-22%252Fimage%252F7d6aa15b-22ac-4b3f-9732-fd4b26aea4a5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS65KSU/2025-10-22/image/7d6aa15b-22ac-4b3f-9732-fd4b26aea4a5_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8ec9234c-0d71-5d07-b7f0-d851996db0b8
2025-12-01 19:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e756210>
2025-12-01 19:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a728f23-a2e4-58e0-9257-1bf0dccb119d/8a728f23-a2e4-58e0-9257-1bf0dccb119d_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYY22CCK%252F2025-12-01%252Fimage%252Ff6ba50cc-03ed-4a91-a78c-c07f0c797423_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YY22CCK/2025-12-01/image/f6ba50cc-03ed-4a91-a78c-c07f0c797423_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8a728f23-a2e4-58e0-9257-1bf0dccb119d
2025-12-01 19:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e755c90>
2025-12-01 19:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2baa3a6-d796-5fe7-92d1-862ebf3d40ce/c2baa3a6-d796-5fe7-92d1-862ebf3d40ce_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F1f65dd65-c576-4291-9917-28d53934a063.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/1f65dd65-c576-4291-9917-28d53934a063.jpg?w=600 saved to cache
2025-12-01 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c2baa3a6-d796-5fe7-92d1-862ebf3d40ce
2025-12-01 19:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e7555d0>
2025-12-01 19:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4471d1-1330-5f18-bc6b-f50165d7cebc/9b4471d1-1330-5f18-bc6b-f50165d7cebc_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fa09ffd85-aa9c-4794-a662-3a2a796086de.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/a09ffd85-aa9c-4794-a662-3a2a796086de.jpg?w=600 saved to cache
2025-12-01 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b4471d1-1330-5f18-bc6b-f50165d7cebc
2025-12-01 19:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GK17LHL/2025-10-14/image/a110cd1b-3dba-4af0-9264-9bf7688d62ed_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116288981?view=catalogue)
2025-12-01 19:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YY22CCK/2025-12-01/image/7ab7ca21-31fc-44f4-a6b2-8120750fbf9f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117600618?view=catalogue)
2025-12-01 19:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS65KSU/2025-10-22/image/702e4ba9-c8c1-4785-8219-825aa82a60b1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/60238390?view=catalogue)
2025-12-01 19:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/f0aaf9f1-34d5-4896-9c71-5af5f6fe92cb.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616509?view=catalogue)
2025-12-01 19:02:01 [astonbarclay.gb] INFO: Found listing with ID: 117628272
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117628272%27 HTTP/1.1" 200 None
2025-12-01 19:02:01 [astonbarclay.gb] INFO: Scrape type for 117628272: 1
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYS65KSU%252F2025-10-22%252Fimage%252F395bda17-874f-40d3-a2c2-ca09cce26ae3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS65KSU/2025-10-22/image/395bda17-874f-40d3-a2c2-ca09cce26ae3_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYY22CCK%252F2025-12-01%252Fimage%252F9861ece8-b5b0-4add-9f6f-fc36dc70ed67_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YY22CCK/2025-12-01/image/9861ece8-b5b0-4add-9f6f-fc36dc70ed67_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fd3695aa3-bf2a-4c69-bfc9-d2f025f4f1c1.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/d3695aa3-bf2a-4c69-bfc9-d2f025f4f1c1.jpg?w=600 not downloaded yet
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGK17LHL%252F2025-10-14%252Fimage%252F14bea6ed-7b1f-4dc7-a9f8-447f4375d7a2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK17LHL/2025-10-14/image/14bea6ed-7b1f-4dc7-a9f8-447f4375d7a2_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e408e10>
2025-12-01 19:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1d41c3-9a55-5035-95b3-78f2642f8712/8d1d41c3-9a55-5035-95b3-78f2642f8712_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAGZ6324%252F2025-11-20%252Fimage%252F4c4b08ca-f6e7-4fc6-9f40-7f0695d05a60_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AGZ6324/2025-11-20/image/4c4b08ca-f6e7-4fc6-9f40-7f0695d05a60_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8d1d41c3-9a55-5035-95b3-78f2642f8712
2025-12-01 19:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e417d10>
2025-12-01 19:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ec9234c-0d71-5d07-b7f0-d851996db0b8/8ec9234c-0d71-5d07-b7f0-d851996db0b8_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS65KSU%252F2025-10-22%252Fimage%252Fe89c3920-3b2e-4169-aae8-b61d86f81059_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS65KSU/2025-10-22/image/e89c3920-3b2e-4169-aae8-b61d86f81059_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8ec9234c-0d71-5d07-b7f0-d851996db0b8
2025-12-01 19:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e4099d0>
2025-12-01 19:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_9.jpg HTTP/1.1" 201 0
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM74SKU%252F2025-12-01%252Fimage%252F882a1277-8154-4c61-ac9b-05ebbfb39dab_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM74SKU/2025-12-01/image/882a1277-8154-4c61-ac9b-05ebbfb39dab_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a7fd25af-1c0c-5745-a7fa-634525bcac68
2025-12-01 19:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LY74DXW/2025-11-10/image/df9ad979-7c37-4b10-92f0-fe7e54c7045c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117023136?view=catalogue)
2025-12-01 19:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AP23VKB/2025-11-25/image/4028a888-6714-4fe7-8672-1bfb808745ee_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117185008?view=catalogue)
2025-12-01 19:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV24VUY/2025-11-25/image/354b23e8-7435-4583-a6e5-98f7080e99b9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117416921?view=catalogue)
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX73WOH%252F2025-11-12%252Fimage%252F297cf991-9b8e-4ec8-855d-da5f4de84bfb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX73WOH/2025-11-12/image/297cf991-9b8e-4ec8-855d-da5f4de84bfb_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAP23VKB%252F2025-11-25%252Fimage%252F73b8cc7a-bea7-4a20-b83b-06d3cb3603e7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP23VKB/2025-11-25/image/73b8cc7a-bea7-4a20-b83b-06d3cb3603e7_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLY74DXW%252F2025-11-10%252Fimage%252F4977023c-527b-4d14-9124-770879b828a4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74DXW/2025-11-10/image/4977023c-527b-4d14-9124-770879b828a4_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV24VUY%252F2025-11-25%252Fimage%252Fe918fe75-fb1b-41c3-b0ae-de85303bd5b9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24VUY/2025-11-25/image/e918fe75-fb1b-41c3-b0ae-de85303bd5b9_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117625956?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117360572?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f50646f2b10>
2025-12-01 19:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2/1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGK17LHL%252F2025-10-14%252Fimage%252Fccab1513-0561-4d33-86f5-0dc2d1ccc9ec_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK17LHL/2025-10-14/image/ccab1513-0561-4d33-86f5-0dc2d1ccc9ec_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2
2025-12-01 19:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e40d610>
2025-12-01 19:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a728f23-a2e4-58e0-9257-1bf0dccb119d/8a728f23-a2e4-58e0-9257-1bf0dccb119d_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYY22CCK%252F2025-12-01%252Fimage%252F450995cd-724b-48fd-811b-43599eb75cad_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YY22CCK/2025-12-01/image/450995cd-724b-48fd-811b-43599eb75cad_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8a728f23-a2e4-58e0-9257-1bf0dccb119d
2025-12-01 19:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f2367d0>
2025-12-01 19:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2baa3a6-d796-5fe7-92d1-862ebf3d40ce/c2baa3a6-d796-5fe7-92d1-862ebf3d40ce_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F95f30695-1ae4-4be3-b923-20e4d45d0d5d.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/95f30695-1ae4-4be3-b923-20e4d45d0d5d.jpg?w=600 saved to cache
2025-12-01 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c2baa3a6-d796-5fe7-92d1-862ebf3d40ce
2025-12-01 19:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e603a50>
2025-12-01 19:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4471d1-1330-5f18-bc6b-f50165d7cebc/9b4471d1-1330-5f18-bc6b-f50165d7cebc_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Feb66f7d8-e6e2-4fbc-9292-1f064c93c791.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/eb66f7d8-e6e2-4fbc-9292-1f064c93c791.jpg?w=600 saved to cache
2025-12-01 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b4471d1-1330-5f18-bc6b-f50165d7cebc
2025-12-01 19:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GK17LHL/2025-10-14/image/9b0f9adc-2807-4720-bdaa-81cf105c406d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116288981?view=catalogue)
2025-12-01 19:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YY22CCK/2025-12-01/image/1a7bc335-d7b0-4257-9bfb-3920e9f718ae_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117600618?view=catalogue)
2025-12-01 19:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/c8a493b3-142a-42fb-b86c-952291c4babb.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616509?view=catalogue)
2025-12-01 19:02:03 [astonbarclay.gb] INFO: Found listing with ID: 117316150
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117316150%27 HTTP/1.1" 200 None
2025-12-01 19:02:03 [astonbarclay.gb] INFO: Scrape type for 117316150: 0
2025-12-01 19:02:03 [astonbarclay.gb] INFO: Found listing with ID: 117268826
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117268826%27 HTTP/1.1" 200 None
2025-12-01 19:02:03 [astonbarclay.gb] INFO: Scrape type for 117268826: 0
2025-12-01 19:02:03 [astonbarclay.gb] INFO: Found listing with ID: 116872991
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116872991%27 HTTP/1.1" 200 None
2025-12-01 19:02:03 [astonbarclay.gb] INFO: Scrape type for 116872991: 0
2025-12-01 19:02:03 [astonbarclay.gb] INFO: Found listing with ID: 117106625
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117106625%27 HTTP/1.1" 200 None
2025-12-01 19:02:03 [astonbarclay.gb] INFO: Scrape type for 117106625: 0
2025-12-01 19:02:03 [astonbarclay.gb] INFO: Found listing with ID: 117629580
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117629580%27 HTTP/1.1" 200 None
2025-12-01 19:02:03 [astonbarclay.gb] INFO: Scrape type for 117629580: 1
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FGK17LHL%252F2025-10-14%252Fimage%252F27af64a2-00ef-4418-bdfc-297f7617e5fb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK17LHL/2025-10-14/image/27af64a2-00ef-4418-bdfc-297f7617e5fb_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117406754?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e7e7c90>
2025-12-01 19:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4471d1-1330-5f18-bc6b-f50165d7cebc/9b4471d1-1330-5f18-bc6b-f50165d7cebc_image_9.jpg HTTP/1.1" 201 0
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F650216a1-c723-4e6d-94d7-f75a778e1e9f.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/650216a1-c723-4e6d-94d7-f75a778e1e9f.jpg?w=600 saved to cache
2025-12-01 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b4471d1-1330-5f18-bc6b-f50165d7cebc
2025-12-01 19:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS65KSU/2025-10-22/image/36bdecec-d520-4b0c-93a0-29f204ad4f61_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/60238390?view=catalogue)
2025-12-01 19:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV24VUY/2025-11-25/image/412e036c-b41a-4409-8ff2-15242e796bd8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117416921?view=catalogue)
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX73WOH%252F2025-11-12%252Fimage%252Fa2788cd7-85ad-4861-b146-c6dd9637c0ae_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX73WOH/2025-11-12/image/a2788cd7-85ad-4861-b146-c6dd9637c0ae_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAP23VKB%252F2025-11-25%252Fimage%252F6827af7d-8ef4-40a8-83ab-6c1644cb8ac4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP23VKB/2025-11-25/image/6827af7d-8ef4-40a8-83ab-6c1644cb8ac4_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLY74DXW%252F2025-11-10%252Fimage%252F53d10d18-a2e9-4433-9d71-d104163cd4c1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74DXW/2025-11-10/image/53d10d18-a2e9-4433-9d71-d104163cd4c1_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV24VUY%252F2025-11-25%252Fimage%252Fd7fe0ebe-602a-47d4-881b-f5a911f9ab25_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24VUY/2025-11-25/image/d7fe0ebe-602a-47d4-881b-f5a911f9ab25_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f22e9d0>
2025-12-01 19:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2/1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGK17LHL%252F2025-10-14%252Fimage%252Fa110cd1b-3dba-4af0-9264-9bf7688d62ed_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK17LHL/2025-10-14/image/a110cd1b-3dba-4af0-9264-9bf7688d62ed_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2
2025-12-01 19:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e63ccd0>
2025-12-01 19:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a728f23-a2e4-58e0-9257-1bf0dccb119d/8a728f23-a2e4-58e0-9257-1bf0dccb119d_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYY22CCK%252F2025-12-01%252Fimage%252F7ab7ca21-31fc-44f4-a6b2-8120750fbf9f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YY22CCK/2025-12-01/image/7ab7ca21-31fc-44f4-a6b2-8120750fbf9f_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8a728f23-a2e4-58e0-9257-1bf0dccb119d
2025-12-01 19:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e63e010>
2025-12-01 19:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ec9234c-0d71-5d07-b7f0-d851996db0b8/8ec9234c-0d71-5d07-b7f0-d851996db0b8_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS65KSU%252F2025-10-22%252Fimage%252F702e4ba9-c8c1-4785-8219-825aa82a60b1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS65KSU/2025-10-22/image/702e4ba9-c8c1-4785-8219-825aa82a60b1_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8ec9234c-0d71-5d07-b7f0-d851996db0b8
2025-12-01 19:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e63ed90>
2025-12-01 19:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2baa3a6-d796-5fe7-92d1-862ebf3d40ce/c2baa3a6-d796-5fe7-92d1-862ebf3d40ce_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Ff0aaf9f1-34d5-4896-9c71-5af5f6fe92cb.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/f0aaf9f1-34d5-4896-9c71-5af5f6fe92cb.jpg?w=600 saved to cache
2025-12-01 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c2baa3a6-d796-5fe7-92d1-862ebf3d40ce
2025-12-01 19:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GK17LHL/2025-10-14/image/d3df424d-39b1-4909-ad2b-e100b16fd096_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116288981?view=catalogue)
2025-12-01 19:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YY22CCK/2025-12-01/image/f581f143-23e8-4bc1-a47b-9ab712f16a2a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117600618?view=catalogue)
2025-12-01 19:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS65KSU/2025-10-22/image/f4608216-bca5-402e-9195-8aa0fec2b3d5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/60238390?view=catalogue)
2025-12-01 19:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/ff90701b-cb11-4d01-bd33-9411a417f231.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616509?view=catalogue)
2025-12-01 19:02:04 [astonbarclay.gb] INFO: Found listing with ID: 117421105
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117421105%27 HTTP/1.1" 200 None
2025-12-01 19:02:04 [astonbarclay.gb] INFO: Scrape type for 117421105: 0
2025-12-01 19:02:04 [astonbarclay.gb] INFO: Found listing with ID: 117260057
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117260057%27 HTTP/1.1" 200 None
2025-12-01 19:02:04 [astonbarclay.gb] INFO: Scrape type for 117260057: 0
2025-12-01 19:02:04 [astonbarclay.gb] INFO: Found listing with ID: 117632895
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117632895%27 HTTP/1.1" 200 None
2025-12-01 19:02:04 [astonbarclay.gb] INFO: Scrape type for 117632895: 1
2025-12-01 19:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e93a110>
2025-12-01 19:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc3d0ce7-7a35-5a36-9894-7cc131d3a49b/cc3d0ce7-7a35-5a36-9894-7cc131d3a49b_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLY74DXW%252F2025-11-10%252Fimage%252Fdf9ad979-7c37-4b10-92f0-fe7e54c7045c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74DXW/2025-11-10/image/df9ad979-7c37-4b10-92f0-fe7e54c7045c_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc3d0ce7-7a35-5a36-9894-7cc131d3a49b
2025-12-01 19:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e7e98d0>
2025-12-01 19:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bc2920f-55ca-53ab-84a8-db2242b7bc17/4bc2920f-55ca-53ab-84a8-db2242b7bc17_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAP23VKB%252F2025-11-25%252Fimage%252F4028a888-6714-4fe7-8672-1bfb808745ee_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP23VKB/2025-11-25/image/4028a888-6714-4fe7-8672-1bfb808745ee_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4bc2920f-55ca-53ab-84a8-db2242b7bc17
2025-12-01 19:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e758590>
2025-12-01 19:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6071c6b2-0f41-5f72-90bd-eb2c31a3d527/6071c6b2-0f41-5f72-90bd-eb2c31a3d527_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV24VUY%252F2025-11-25%252Fimage%252F354b23e8-7435-4583-a6e5-98f7080e99b9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24VUY/2025-11-25/image/354b23e8-7435-4583-a6e5-98f7080e99b9_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6071c6b2-0f41-5f72-90bd-eb2c31a3d527
2025-12-01 19:02:05 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117625956, 'registration': 'LT75NVV', 'account': 'MOT070', 'make': 'MERCEDES-BENZ', 'model': 'GLA HATCHBACK', 'derivative': 'GLA 200 AMG Line Executive 5dr Auto', 'mileage': 1655, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-09-05', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 150, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ffa2c1d2-a88d-41bb-849f-c7303885101c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:05 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117625956, 'registration': 'LT75NVV', 'account': 'MOT070', 'make': 'MERCEDES-BENZ', 'model': 'GLA HATCHBACK', 'derivative': 'GLA 200 AMG Line Executive 5dr Auto', 'mileage': 1655, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-09-05', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 150, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ffa2c1d2-a88d-41bb-849f-c7303885101c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9996edc9-379f-5252-b45d-b27f85719929 with identifier: 117625956
2025-12-01 19:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9996edc9-379f-5252-b45d-b27f85719929 with scrape type 1
2025-12-01 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 9996edc9-379f-5252-b45d-b27f85719929
2025-12-01 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 9996edc9-379f-5252-b45d-b27f85719929
2025-12-01 19:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9996edc9-379f-5252-b45d-b27f85719929, identifier: 117625956
2025-12-01 19:02:06 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117360572, 'registration': 'EA22LMF', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'ARKANA ESTATE', 'derivative': '1.6 E-TECH Hybrid 145 R.S. Line 5dr Auto', 'mileage': 37613, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-04-20', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-05-27', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EA22LMF/2025-11-25/image/64d7028f-57ba-41f9-ab78-8c4ca293b44d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/091deb6a-081a-45c0-b663-78520bfc5de3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/5edd55b9-8391-4b7a-815c-90f37d9022b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/ae69f1f2-33a1-4b7b-84d2-66e956a65723_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/35a16fbf-67d3-46e9-9086-9f914d67cc30_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/cc0eab91-5f1b-4f73-b376-2a71ecf9d74a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/abba97c3-044c-4fa7-a26e-1db022543274_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/e8519c3c-fa46-4b6b-855a-350ded7253d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/85b9e472-5d81-415a-a9fc-f89f07f3faf9_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/23 19k - 05/25 33k', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 109, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e0420431-2121-4f42-8eea-19b0982987ed.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:06 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117360572, 'registration': 'EA22LMF', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'ARKANA ESTATE', 'derivative': '1.6 E-TECH Hybrid 145 R.S. Line 5dr Auto', 'mileage': 37613, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-04-20', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-05-27', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EA22LMF/2025-11-25/image/64d7028f-57ba-41f9-ab78-8c4ca293b44d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/091deb6a-081a-45c0-b663-78520bfc5de3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/5edd55b9-8391-4b7a-815c-90f37d9022b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/ae69f1f2-33a1-4b7b-84d2-66e956a65723_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/35a16fbf-67d3-46e9-9086-9f914d67cc30_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/cc0eab91-5f1b-4f73-b376-2a71ecf9d74a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/abba97c3-044c-4fa7-a26e-1db022543274_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/e8519c3c-fa46-4b6b-855a-350ded7253d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/85b9e472-5d81-415a-a9fc-f89f07f3faf9_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/23 19k - 05/25 33k', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 109, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e0420431-2121-4f42-8eea-19b0982987ed.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1 with identifier: 117360572
2025-12-01 19:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1 with scrape type 1
2025-12-01 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1
2025-12-01 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA22LMF%252F2025-11-25%252Fimage%252F64d7028f-57ba-41f9-ab78-8c4ca293b44d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA22LMF/2025-11-25/image/64d7028f-57ba-41f9-ab78-8c4ca293b44d_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AP23VKB/2025-11-25/image/a476a35b-c2c9-4f1d-b573-70ed1785a53b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117185008?view=catalogue)
2025-12-01 19:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV24VUY/2025-11-25/image/47bf93eb-86e5-4b1e-b422-c6ab74baf2f1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117416921?view=catalogue)
2025-12-01 19:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LY74DXW/2025-11-10/image/56739470-ba08-4f64-985d-cec7b10b6ed0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117023136?view=catalogue)
2025-12-01 19:02:06 [scrapy.extensions.logstats] INFO: Crawled 86 pages (at 36 pages/min), scraped 36 items (at 21 items/min)
2025-12-01 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX73WOH%252F2025-11-12%252Fimage%252F1aa2008d-b6f7-4728-a5aa-2bac1d7a31a7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX73WOH/2025-11-12/image/1aa2008d-b6f7-4728-a5aa-2bac1d7a31a7_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAP23VKB%252F2025-11-25%252Fimage%252F40f55a5d-86b6-46c9-b3ed-6aa2fb02781e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP23VKB/2025-11-25/image/40f55a5d-86b6-46c9-b3ed-6aa2fb02781e_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLY74DXW%252F2025-11-10%252Fimage%252Fce74b827-ea4f-4c56-965e-aa8d2f11a5f4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74DXW/2025-11-10/image/ce74b827-ea4f-4c56-965e-aa8d2f11a5f4_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV24VUY%252F2025-11-25%252Fimage%252F5568309f-8fd9-46c9-a927-68d10a3f2907_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24VUY/2025-11-25/image/5568309f-8fd9-46c9-a927-68d10a3f2907_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9996edc9-379f-5252-b45d-b27f85719929 with identifier: 117625956
2025-12-01 19:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9996edc9-379f-5252-b45d-b27f85719929 with identifier: 117625956
2025-12-01 19:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9996edc9-379f-5252-b45d-b27f85719929 with identifier: 117625956 to the API
2025-12-01 19:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%279996edc9-379f-5252-b45d-b27f85719929%27 HTTP/1.1" 200 None
2025-12-01 19:02:06 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 9996edc9-379f-5252-b45d-b27f85719929: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:02:05 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117625956?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '9996edc9-379f-5252-b45d-b27f85719929',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LT75NVV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117625956',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'GLA HATCHBACK',
 'odometer': 1655,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-09-05',
 'seller_name': 'Motability Operations',
 'title': 'MERCEDES-BENZ GLA HATCHBACK GLA 200 AMG Line Executive 5dr Auto',
 'transmission': 'automatic',
 'trim': 'GLA 200 AMG Line Executive 5dr Auto',
 'vin': None,
 'year': 2025}
2025-12-01 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117625956%27 HTTP/1.1" 200 None
2025-12-01 19:02:06 [astonbarclay.gb] INFO: Saving data for 117625956: {'created_time': 1764615726.70733, 'last_price_update_time': 1764615726.707339, 'auction_closing_time': 1765792800.0}
2025-12-01 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117625956') HTTP/1.1" 204 0
2025-12-01 19:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6714d0>
2025-12-01 19:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2/1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGK17LHL%252F2025-10-14%252Fimage%252F9b0f9adc-2807-4720-bdaa-81cf105c406d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK17LHL/2025-10-14/image/9b0f9adc-2807-4720-bdaa-81cf105c406d_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2
2025-12-01 19:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e778250>
2025-12-01 19:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a728f23-a2e4-58e0-9257-1bf0dccb119d/8a728f23-a2e4-58e0-9257-1bf0dccb119d_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYY22CCK%252F2025-12-01%252Fimage%252F1a7bc335-d7b0-4257-9bfb-3920e9f718ae_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YY22CCK/2025-12-01/image/1a7bc335-d7b0-4257-9bfb-3920e9f718ae_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8a728f23-a2e4-58e0-9257-1bf0dccb119d
2025-12-01 19:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e9c3050>
2025-12-01 19:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2baa3a6-d796-5fe7-92d1-862ebf3d40ce/c2baa3a6-d796-5fe7-92d1-862ebf3d40ce_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fc8a493b3-142a-42fb-b86c-952291c4babb.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/c8a493b3-142a-42fb-b86c-952291c4babb.jpg?w=600 saved to cache
2025-12-01 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c2baa3a6-d796-5fe7-92d1-862ebf3d40ce
2025-12-01 19:02:07 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117406754, 'registration': 'LB72MJE', 'account': 'MOT071', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE', 'derivative': '109kW Life Pure 52kWh 5dr Auto', 'mileage': 12018, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-12-30', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LB72MJE/2025-11-25/image/f846d76e-d8e7-425a-b3ef-84a6036cdb7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/1c0d997f-0a2c-4dcd-9016-5742382d2f69_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/6f6e13d7-44d5-4208-94dd-38804e2ff26f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/7fee3152-b978-4104-b97f-67f4b7693970_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/66d8b059-aed6-4d1a-b93c-e1fa78602e94_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/428dff45-5436-4f84-b534-e595767e5952_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/b3d66280-1e04-46b5-af63-c070920af967_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/b3e68666-76b5-4329-be30-68e52f2e2c69_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/6f9dfc56-ef94-47f2-91ed-a6f16b91f58e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/e7c57c5d-c232-4dbb-8965-083f63171029_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a1d408a1-da06-4902-9169-2e8f8ab616f4.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:07 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117406754, 'registration': 'LB72MJE', 'account': 'MOT071', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE', 'derivative': '109kW Life Pure 52kWh 5dr Auto', 'mileage': 12018, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-12-30', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LB72MJE/2025-11-25/image/f846d76e-d8e7-425a-b3ef-84a6036cdb7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/1c0d997f-0a2c-4dcd-9016-5742382d2f69_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/6f6e13d7-44d5-4208-94dd-38804e2ff26f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/7fee3152-b978-4104-b97f-67f4b7693970_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/66d8b059-aed6-4d1a-b93c-e1fa78602e94_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/428dff45-5436-4f84-b534-e595767e5952_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/b3d66280-1e04-46b5-af63-c070920af967_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/b3e68666-76b5-4329-be30-68e52f2e2c69_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/6f9dfc56-ef94-47f2-91ed-a6f16b91f58e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/e7c57c5d-c232-4dbb-8965-083f63171029_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a1d408a1-da06-4902-9169-2e8f8ab616f4.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b54e961e-8138-5db1-80ff-a71013059b82 with identifier: 117406754
2025-12-01 19:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b54e961e-8138-5db1-80ff-a71013059b82 with scrape type 1
2025-12-01 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b54e961e-8138-5db1-80ff-a71013059b82
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB72MJE%252F2025-11-25%252Fimage%252Ff846d76e-d8e7-425a-b3ef-84a6036cdb7d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB72MJE/2025-11-25/image/f846d76e-d8e7-425a-b3ef-84a6036cdb7d_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GK17LHL/2025-10-14/image/14bea6ed-7b1f-4dc7-a9f8-447f4375d7a2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116288981?view=catalogue)
2025-12-01 19:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/d3695aa3-bf2a-4c69-bfc9-d2f025f4f1c1.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117616509?view=catalogue)
2025-12-01 19:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YY22CCK/2025-12-01/image/9861ece8-b5b0-4add-9f6f-fc36dc70ed67_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117600618?view=catalogue)
2025-12-01 19:02:07 [astonbarclay.gb] INFO: Found listing with ID: 116269848
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116269848%27 HTTP/1.1" 200 None
2025-12-01 19:02:07 [astonbarclay.gb] INFO: Scrape type for 116269848: 0
2025-12-01 19:02:07 [astonbarclay.gb] INFO: Found listing with ID: 117407792
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407792%27 HTTP/1.1" 200 None
2025-12-01 19:02:07 [astonbarclay.gb] INFO: Scrape type for 117407792: 0
2025-12-01 19:02:07 [astonbarclay.gb] INFO: Found listing with ID: 116265155
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116265155%27 HTTP/1.1" 200 None
2025-12-01 19:02:07 [astonbarclay.gb] INFO: Scrape type for 116265155: 0
2025-12-01 19:02:07 [astonbarclay.gb] INFO: Found listing with ID: 117143069
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117143069%27 HTTP/1.1" 200 None
2025-12-01 19:02:07 [astonbarclay.gb] INFO: Scrape type for 117143069: 0
2025-12-01 19:02:07 [astonbarclay.gb] INFO: Found listing with ID: 117634646
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117634646%27 HTTP/1.1" 200 None
2025-12-01 19:02:07 [astonbarclay.gb] INFO: Scrape type for 117634646: 1
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA22LMF%252F2025-11-25%252Fimage%252F091deb6a-081a-45c0-b663-78520bfc5de3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA22LMF/2025-11-25/image/091deb6a-081a-45c0-b663-78520bfc5de3_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117086159?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f285ed0>
2025-12-01 19:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ec9234c-0d71-5d07-b7f0-d851996db0b8/8ec9234c-0d71-5d07-b7f0-d851996db0b8_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS65KSU%252F2025-10-22%252Fimage%252F36bdecec-d520-4b0c-93a0-29f204ad4f61_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS65KSU/2025-10-22/image/36bdecec-d520-4b0c-93a0-29f204ad4f61_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8ec9234c-0d71-5d07-b7f0-d851996db0b8
2025-12-01 19:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e9c2d90>
2025-12-01 19:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6071c6b2-0f41-5f72-90bd-eb2c31a3d527/6071c6b2-0f41-5f72-90bd-eb2c31a3d527_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV24VUY%252F2025-11-25%252Fimage%252F412e036c-b41a-4409-8ff2-15242e796bd8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24VUY/2025-11-25/image/412e036c-b41a-4409-8ff2-15242e796bd8_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6071c6b2-0f41-5f72-90bd-eb2c31a3d527
2025-12-01 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV24VUY/2025-11-25/image/e918fe75-fb1b-41c3-b0ae-de85303bd5b9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117416921?view=catalogue)
2025-12-01 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LY74DXW/2025-11-10/image/4977023c-527b-4d14-9124-770879b828a4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117023136?view=catalogue)
2025-12-01 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS65KSU/2025-10-22/image/395bda17-874f-40d3-a2c2-ca09cce26ae3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/60238390?view=catalogue)
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX73WOH%252F2025-11-12%252Fimage%252F1cf49a13-1c13-45ef-b1ce-5a8a7c1a5708_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX73WOH/2025-11-12/image/1cf49a13-1c13-45ef-b1ce-5a8a7c1a5708_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAP23VKB%252F2025-11-25%252Fimage%252Fb2fd1c98-6d01-4cfd-abb7-8fe2365fc477_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP23VKB/2025-11-25/image/b2fd1c98-6d01-4cfd-abb7-8fe2365fc477_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLY74DXW%252F2025-11-10%252Fimage%252F6cfe5c9f-f441-42a1-8969-c3b953eefa2e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74DXW/2025-11-10/image/6cfe5c9f-f441-42a1-8969-c3b953eefa2e_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV24VUY%252F2025-11-25%252Fimage%252Fbdf87b18-11d9-46f6-afdb-9207355da6d6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24VUY/2025-11-25/image/bdf87b18-11d9-46f6-afdb-9207355da6d6_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB72MJE%252F2025-11-25%252Fimage%252F1c0d997f-0a2c-4dcd-9016-5742382d2f69_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB72MJE/2025-11-25/image/1c0d997f-0a2c-4dcd-9016-5742382d2f69_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e8eb990>
2025-12-01 19:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2/1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGK17LHL%252F2025-10-14%252Fimage%252Fd3df424d-39b1-4909-ad2b-e100b16fd096_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK17LHL/2025-10-14/image/d3df424d-39b1-4909-ad2b-e100b16fd096_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2
2025-12-01 19:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e66e2d0>
2025-12-01 19:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a728f23-a2e4-58e0-9257-1bf0dccb119d/8a728f23-a2e4-58e0-9257-1bf0dccb119d_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYY22CCK%252F2025-12-01%252Fimage%252Ff581f143-23e8-4bc1-a47b-9ab712f16a2a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YY22CCK/2025-12-01/image/f581f143-23e8-4bc1-a47b-9ab712f16a2a_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8a728f23-a2e4-58e0-9257-1bf0dccb119d
2025-12-01 19:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f50645ab390>
2025-12-01 19:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ec9234c-0d71-5d07-b7f0-d851996db0b8/8ec9234c-0d71-5d07-b7f0-d851996db0b8_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS65KSU%252F2025-10-22%252Fimage%252Ff4608216-bca5-402e-9195-8aa0fec2b3d5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS65KSU/2025-10-22/image/f4608216-bca5-402e-9195-8aa0fec2b3d5_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8ec9234c-0d71-5d07-b7f0-d851996db0b8
2025-12-01 19:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e8f89d0>
2025-12-01 19:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2baa3a6-d796-5fe7-92d1-862ebf3d40ce/c2baa3a6-d796-5fe7-92d1-862ebf3d40ce_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fff90701b-cb11-4d01-bd33-9411a417f231.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/ff90701b-cb11-4d01-bd33-9411a417f231.jpg?w=600 saved to cache
2025-12-01 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c2baa3a6-d796-5fe7-92d1-862ebf3d40ce
2025-12-01 19:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GK17LHL/2025-10-14/image/27af64a2-00ef-4418-bdfc-297f7617e5fb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/116288981?view=catalogue)
2025-12-01 19:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX73WOH/2025-11-12/image/297cf991-9b8e-4ec8-855d-da5f4de84bfb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117080670?view=catalogue)
2025-12-01 19:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AP23VKB/2025-11-25/image/73b8cc7a-bea7-4a20-b83b-06d3cb3603e7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117185008?view=catalogue)
2025-12-01 19:02:09 [astonbarclay.gb] INFO: Found listing with ID: 117550785
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550785%27 HTTP/1.1" 200 None
2025-12-01 19:02:09 [astonbarclay.gb] INFO: Scrape type for 117550785: 0
2025-12-01 19:02:09 [astonbarclay.gb] INFO: Found listing with ID: 117633313
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117633313%27 HTTP/1.1" 200 None
2025-12-01 19:02:09 [astonbarclay.gb] INFO: Scrape type for 117633313: 1
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA22LMF%252F2025-11-25%252Fimage%252F5edd55b9-8391-4b7a-815c-90f37d9022b8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA22LMF/2025-11-25/image/5edd55b9-8391-4b7a-815c-90f37d9022b8_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e41a110>
2025-12-01 19:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bc2920f-55ca-53ab-84a8-db2242b7bc17/4bc2920f-55ca-53ab-84a8-db2242b7bc17_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAP23VKB%252F2025-11-25%252Fimage%252Fa476a35b-c2c9-4f1d-b573-70ed1785a53b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP23VKB/2025-11-25/image/a476a35b-c2c9-4f1d-b573-70ed1785a53b_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4bc2920f-55ca-53ab-84a8-db2242b7bc17
2025-12-01 19:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e606290>
2025-12-01 19:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6071c6b2-0f41-5f72-90bd-eb2c31a3d527/6071c6b2-0f41-5f72-90bd-eb2c31a3d527_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV24VUY%252F2025-11-25%252Fimage%252F47bf93eb-86e5-4b1e-b422-c6ab74baf2f1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24VUY/2025-11-25/image/47bf93eb-86e5-4b1e-b422-c6ab74baf2f1_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6071c6b2-0f41-5f72-90bd-eb2c31a3d527
2025-12-01 19:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e705690>
2025-12-01 19:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc3d0ce7-7a35-5a36-9894-7cc131d3a49b/cc3d0ce7-7a35-5a36-9894-7cc131d3a49b_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLY74DXW%252F2025-11-10%252Fimage%252F56739470-ba08-4f64-985d-cec7b10b6ed0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74DXW/2025-11-10/image/56739470-ba08-4f64-985d-cec7b10b6ed0_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cc3d0ce7-7a35-5a36-9894-7cc131d3a49b
2025-12-01 19:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX73WOH/2025-11-12/image/776351df-9ca4-451e-b0c9-d49c1a035615_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117080670?view=catalogue)
2025-12-01 19:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV24VUY/2025-11-25/image/d7fe0ebe-602a-47d4-881b-f5a911f9ab25_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117416921?view=catalogue)
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX73WOH%252F2025-11-12%252Fimage%252Feb300b4c-adb3-4a28-a652-603e10241439_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX73WOH/2025-11-12/image/eb300b4c-adb3-4a28-a652-603e10241439_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAP23VKB%252F2025-11-25%252Fimage%252F4c7837b0-f5ad-4a33-b31a-c23f0903389c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP23VKB/2025-11-25/image/4c7837b0-f5ad-4a33-b31a-c23f0903389c_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLY74DXW%252F2025-11-10%252Fimage%252Fe5867b0b-c2c6-4b63-8993-f59574ebccd2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74DXW/2025-11-10/image/e5867b0b-c2c6-4b63-8993-f59574ebccd2_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV24VUY%252F2025-11-25%252Fimage%252Faebf380c-8ebc-48aa-9974-792df1c3fe47_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24VUY/2025-11-25/image/aebf380c-8ebc-48aa-9974-792df1c3fe47_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB72MJE%252F2025-11-25%252Fimage%252F6f6e13d7-44d5-4208-94dd-38804e2ff26f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB72MJE/2025-11-25/image/6f6e13d7-44d5-4208-94dd-38804e2ff26f_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e8440d0>
2025-12-01 19:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2/1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGK17LHL%252F2025-10-14%252Fimage%252F14bea6ed-7b1f-4dc7-a9f8-447f4375d7a2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK17LHL/2025-10-14/image/14bea6ed-7b1f-4dc7-a9f8-447f4375d7a2_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2
2025-12-01 19:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e624b50>
2025-12-01 19:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2baa3a6-d796-5fe7-92d1-862ebf3d40ce/c2baa3a6-d796-5fe7-92d1-862ebf3d40ce_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fd3695aa3-bf2a-4c69-bfc9-d2f025f4f1c1.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/d3695aa3-bf2a-4c69-bfc9-d2f025f4f1c1.jpg?w=600 saved to cache
2025-12-01 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c2baa3a6-d796-5fe7-92d1-862ebf3d40ce
2025-12-01 19:02:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c2baa3a6-d796-5fe7-92d1-862ebf3d40ce, skipping ID generation
2025-12-01 19:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2baa3a6-d796-5fe7-92d1-862ebf3d40ce with scrape type 1
2025-12-01 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c2baa3a6-d796-5fe7-92d1-862ebf3d40ce from tracking dictionaries
2025-12-01 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c2baa3a6-d796-5fe7-92d1-862ebf3d40ce sending to next pipeline
2025-12-01 19:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c2baa3a6-d796-5fe7-92d1-862ebf3d40ce, identifier: 117616509
2025-12-01 19:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f2d5e10>
2025-12-01 19:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a728f23-a2e4-58e0-9257-1bf0dccb119d/8a728f23-a2e4-58e0-9257-1bf0dccb119d_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYY22CCK%252F2025-12-01%252Fimage%252F9861ece8-b5b0-4add-9f6f-fc36dc70ed67_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YY22CCK/2025-12-01/image/9861ece8-b5b0-4add-9f6f-fc36dc70ed67_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8a728f23-a2e4-58e0-9257-1bf0dccb119d
2025-12-01 19:02:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8a728f23-a2e4-58e0-9257-1bf0dccb119d, skipping ID generation
2025-12-01 19:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a728f23-a2e4-58e0-9257-1bf0dccb119d with scrape type 1
2025-12-01 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8a728f23-a2e4-58e0-9257-1bf0dccb119d from tracking dictionaries
2025-12-01 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8a728f23-a2e4-58e0-9257-1bf0dccb119d sending to next pipeline
2025-12-01 19:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8a728f23-a2e4-58e0-9257-1bf0dccb119d, identifier: 117600618
2025-12-01 19:02:11 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117086159, 'registration': 'EX75XPS', 'account': 'MOT070', 'make': 'FIAT', 'model': '600 HATCHBACK', 'derivative': '1.2 Hybrid 48V 5dr eDCT-6', 'mileage': 1845, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-09-22', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EX75XPS/2025-11-12/image/ab8329dd-8848-4112-9e88-af9c4f3875ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/cef6c1e8-d17d-442b-85f5-48726819d6c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/24b95ed9-aa5b-4219-9107-14ebe5a6a862_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/391d4949-1912-4335-80e5-e4b6c01e37ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/9e78d511-a5d2-4fd7-9087-1653bd1704fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/ea09524a-2ee5-4844-b24c-c3eee26fa064_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/cc16b2ce-e92a-4f75-b3eb-fcf6091b4188_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/717c3857-ecc0-495c-9106-1f4981935b92_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 109, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1743d3ef-0bd3-48bc-aa4c-9f73f0991a5d.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:11 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117086159, 'registration': 'EX75XPS', 'account': 'MOT070', 'make': 'FIAT', 'model': '600 HATCHBACK', 'derivative': '1.2 Hybrid 48V 5dr eDCT-6', 'mileage': 1845, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-09-22', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EX75XPS/2025-11-12/image/ab8329dd-8848-4112-9e88-af9c4f3875ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/cef6c1e8-d17d-442b-85f5-48726819d6c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/24b95ed9-aa5b-4219-9107-14ebe5a6a862_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/391d4949-1912-4335-80e5-e4b6c01e37ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/9e78d511-a5d2-4fd7-9087-1653bd1704fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/ea09524a-2ee5-4844-b24c-c3eee26fa064_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/cc16b2ce-e92a-4f75-b3eb-fcf6091b4188_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/717c3857-ecc0-495c-9106-1f4981935b92_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 109, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1743d3ef-0bd3-48bc-aa4c-9f73f0991a5d.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40fa02b3-6433-5a93-94dd-bccc5a18ed40 with identifier: 117086159
2025-12-01 19:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40fa02b3-6433-5a93-94dd-bccc5a18ed40 with scrape type 1
2025-12-01 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 40fa02b3-6433-5a93-94dd-bccc5a18ed40
2025-12-01 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX75XPS%252F2025-11-12%252Fimage%252Fab8329dd-8848-4112-9e88-af9c4f3875ae_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX75XPS/2025-11-12/image/ab8329dd-8848-4112-9e88-af9c4f3875ae_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA22LMF/2025-11-25/image/64d7028f-57ba-41f9-ab78-8c4ca293b44d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117360572?view=catalogue)
2025-12-01 19:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AP23VKB/2025-11-25/image/6827af7d-8ef4-40a8-83ab-6c1644cb8ac4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117185008?view=catalogue)
2025-12-01 19:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LY74DXW/2025-11-10/image/53d10d18-a2e9-4433-9d71-d104163cd4c1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117023136?view=catalogue)
2025-12-01 19:02:11 [astonbarclay.gb] INFO: Found listing with ID: 117407486
2025-12-01 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407486%27 HTTP/1.1" 200 None
2025-12-01 19:02:11 [astonbarclay.gb] INFO: Scrape type for 117407486: 0
2025-12-01 19:02:11 [astonbarclay.gb] INFO: Found listing with ID: 117631748
2025-12-01 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117631748%27 HTTP/1.1" 200 None
2025-12-01 19:02:11 [astonbarclay.gb] INFO: Scrape type for 117631748: 1
2025-12-01 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA22LMF%252F2025-11-25%252Fimage%252Fae69f1f2-33a1-4b7b-84d2-66e956a65723_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA22LMF/2025-11-25/image/ae69f1f2-33a1-4b7b-84d2-66e956a65723_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c2baa3a6-d796-5fe7-92d1-862ebf3d40ce with identifier: 117616509
2025-12-01 19:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c2baa3a6-d796-5fe7-92d1-862ebf3d40ce with identifier: 117616509
2025-12-01 19:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c2baa3a6-d796-5fe7-92d1-862ebf3d40ce with identifier: 117616509 to the API
2025-12-01 19:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/d3695aa3-bf2a-4c69-bfc9-d2f025f4f1c1.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'c2baa3a6-d796-5fe7-92d1-862ebf3d40ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'HT66VBN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117616509',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'RENAULT',
 'model': 'CAPTUR HATCHBACK',
 'odometer': 62126,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2baa3a6-d796-5fe7-92d1-862ebf3d40ce/c2baa3a6-d796-5fe7-92d1-862ebf3d40ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48826,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/afff52e5-c5d5-4dc5-9156-b06b7ecba185.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2baa3a6-d796-5fe7-92d1-862ebf3d40ce/c2baa3a6-d796-5fe7-92d1-862ebf3d40ce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49713,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/ebc62edd-cb64-44d8-a2f8-c0b287576e00.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2baa3a6-d796-5fe7-92d1-862ebf3d40ce/c2baa3a6-d796-5fe7-92d1-862ebf3d40ce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36841,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/3de21a25-0c2f-4930-9d9c-1efc9d37938c.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2baa3a6-d796-5fe7-92d1-862ebf3d40ce/c2baa3a6-d796-5fe7-92d1-862ebf3d40ce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36700,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/1f65dd65-c576-4291-9917-28d53934a063.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2baa3a6-d796-5fe7-92d1-862ebf3d40ce/c2baa3a6-d796-5fe7-92d1-862ebf3d40ce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47602,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/95f30695-1ae4-4be3-b923-20e4d45d0d5d.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2baa3a6-d796-5fe7-92d1-862ebf3d40ce/c2baa3a6-d796-5fe7-92d1-862ebf3d40ce_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49355,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/f0aaf9f1-34d5-4896-9c71-5af5f6fe92cb.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2baa3a6-d796-5fe7-92d1-862ebf3d40ce/c2baa3a6-d796-5fe7-92d1-862ebf3d40ce_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45209,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/c8a493b3-142a-42fb-b86c-952291c4babb.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2baa3a6-d796-5fe7-92d1-862ebf3d40ce/c2baa3a6-d796-5fe7-92d1-862ebf3d40ce_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36276,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/ff90701b-cb11-4d01-bd33-9411a417f231.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2baa3a6-d796-5fe7-92d1-862ebf3d40ce/c2baa3a6-d796-5fe7-92d1-862ebf3d40ce_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29985,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/d3695aa3-bf2a-4c69-bfc9-d2f025f4f1c1.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-20',
 'seller_name': 'Vantage Motor Group',
 'title': 'RENAULT CAPTUR HATCHBACK 0.9 TCE 90 Dynamique S Nav 5dr',
 'transmission': 'manual',
 'trim': '0.9 TCE 90 Dynamique S Nav 5dr',
 'vin': None,
 'year': 2017}
2025-12-01 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117616509%27 HTTP/1.1" 200 None
2025-12-01 19:02:11 [astonbarclay.gb] INFO: Saving data for 117616509: {'created_time': 1764615731.809833, 'last_price_update_time': 1764615731.809845, 'auction_closing_time': 1765285200.0}
2025-12-01 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117616509') HTTP/1.1" 204 0
2025-12-01 19:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8a728f23-a2e4-58e0-9257-1bf0dccb119d with identifier: 117600618
2025-12-01 19:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8a728f23-a2e4-58e0-9257-1bf0dccb119d with identifier: 117600618
2025-12-01 19:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 8a728f23-a2e4-58e0-9257-1bf0dccb119d with identifier: 117600618 to the API
2025-12-01 19:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YY22CCK/2025-12-01/image/9861ece8-b5b0-4add-9f6f-fc36dc70ed67_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 177,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '8a728f23-a2e4-58e0-9257-1bf0dccb119d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YY22CCK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117600618',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'AUDI',
 'model': 'Q2 ESTATE',
 'odometer': 41808,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a728f23-a2e4-58e0-9257-1bf0dccb119d/8a728f23-a2e4-58e0-9257-1bf0dccb119d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24201,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/8653385c-446b-4de1-baa2-5bdd068c24b5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a728f23-a2e4-58e0-9257-1bf0dccb119d/8a728f23-a2e4-58e0-9257-1bf0dccb119d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26190,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/67ca57de-2c4f-4b12-8acb-b40a172efb2a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a728f23-a2e4-58e0-9257-1bf0dccb119d/8a728f23-a2e4-58e0-9257-1bf0dccb119d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25749,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/2712a7e7-aac2-47fd-9b05-722c941c767a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a728f23-a2e4-58e0-9257-1bf0dccb119d/8a728f23-a2e4-58e0-9257-1bf0dccb119d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24099,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/f6ba50cc-03ed-4a91-a78c-c07f0c797423_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a728f23-a2e4-58e0-9257-1bf0dccb119d/8a728f23-a2e4-58e0-9257-1bf0dccb119d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37813,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/450995cd-724b-48fd-811b-43599eb75cad_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a728f23-a2e4-58e0-9257-1bf0dccb119d/8a728f23-a2e4-58e0-9257-1bf0dccb119d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42214,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/7ab7ca21-31fc-44f4-a6b2-8120750fbf9f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a728f23-a2e4-58e0-9257-1bf0dccb119d/8a728f23-a2e4-58e0-9257-1bf0dccb119d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41717,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/1a7bc335-d7b0-4257-9bfb-3920e9f718ae_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a728f23-a2e4-58e0-9257-1bf0dccb119d/8a728f23-a2e4-58e0-9257-1bf0dccb119d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40515,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/f581f143-23e8-4bc1-a47b-9ab712f16a2a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a728f23-a2e4-58e0-9257-1bf0dccb119d/8a728f23-a2e4-58e0-9257-1bf0dccb119d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45793,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/YY22CCK/2025-12-01/image/9861ece8-b5b0-4add-9f6f-fc36dc70ed67_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-27',
 'seller_name': 'Hatfields Group',
 'title': 'AUDI Q2 ESTATE 40 TFSI Quattro Vorsprung 5dr S Tronic',
 'transmission': 'automatic',
 'trim': '40 TFSI Quattro Vorsprung 5dr S Tronic',
 'vin': None,
 'year': 2022}
2025-12-01 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600618%27 HTTP/1.1" 200 None
2025-12-01 19:02:12 [astonbarclay.gb] INFO: Saving data for 117600618: {'created_time': 1764615732.188233, 'last_price_update_time': 1764615732.188243, 'auction_closing_time': 1765285200.0}
2025-12-01 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117600618') HTTP/1.1" 204 0
2025-12-01 19:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e863f50>
2025-12-01 19:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6071c6b2-0f41-5f72-90bd-eb2c31a3d527/6071c6b2-0f41-5f72-90bd-eb2c31a3d527_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV24VUY%252F2025-11-25%252Fimage%252Fe918fe75-fb1b-41c3-b0ae-de85303bd5b9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24VUY/2025-11-25/image/e918fe75-fb1b-41c3-b0ae-de85303bd5b9_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6071c6b2-0f41-5f72-90bd-eb2c31a3d527
2025-12-01 19:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e8e7990>
2025-12-01 19:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc3d0ce7-7a35-5a36-9894-7cc131d3a49b/cc3d0ce7-7a35-5a36-9894-7cc131d3a49b_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLY74DXW%252F2025-11-10%252Fimage%252F4977023c-527b-4d14-9124-770879b828a4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74DXW/2025-11-10/image/4977023c-527b-4d14-9124-770879b828a4_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cc3d0ce7-7a35-5a36-9894-7cc131d3a49b
2025-12-01 19:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e541510>
2025-12-01 19:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ec9234c-0d71-5d07-b7f0-d851996db0b8/8ec9234c-0d71-5d07-b7f0-d851996db0b8_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS65KSU%252F2025-10-22%252Fimage%252F395bda17-874f-40d3-a2c2-ca09cce26ae3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS65KSU/2025-10-22/image/395bda17-874f-40d3-a2c2-ca09cce26ae3_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8ec9234c-0d71-5d07-b7f0-d851996db0b8
2025-12-01 19:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX73WOH/2025-11-12/image/a2788cd7-85ad-4861-b146-c6dd9637c0ae_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117080670?view=catalogue)
2025-12-01 19:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB72MJE/2025-11-25/image/f846d76e-d8e7-425a-b3ef-84a6036cdb7d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117406754?view=catalogue)
2025-12-01 19:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV24VUY/2025-11-25/image/5568309f-8fd9-46c9-a927-68d10a3f2907_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117416921?view=catalogue)
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX73WOH%252F2025-11-12%252Fimage%252Fc4a878bd-782c-42f0-91ba-2574458510a0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX73WOH/2025-11-12/image/c4a878bd-782c-42f0-91ba-2574458510a0_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAP23VKB%252F2025-11-25%252Fimage%252F6704290f-a77a-4d02-81e4-97488e185212_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP23VKB/2025-11-25/image/6704290f-a77a-4d02-81e4-97488e185212_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLY74DXW%252F2025-11-10%252Fimage%252Feca87a04-82a3-4493-87ff-0fe616ed978e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74DXW/2025-11-10/image/eca87a04-82a3-4493-87ff-0fe616ed978e_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV24VUY%252F2025-11-25%252Fimage%252F93ffa6d6-6b37-4cb5-8851-bec80ec86d7d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24VUY/2025-11-25/image/93ffa6d6-6b37-4cb5-8851-bec80ec86d7d_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB72MJE%252F2025-11-25%252Fimage%252F7fee3152-b978-4104-b97f-67f4b7693970_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB72MJE/2025-11-25/image/7fee3152-b978-4104-b97f-67f4b7693970_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX75XPS%252F2025-11-12%252Fimage%252Fcef6c1e8-d17d-442b-85f5-48726819d6c8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX75XPS/2025-11-12/image/cef6c1e8-d17d-442b-85f5-48726819d6c8_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e9f5e10>
2025-12-01 19:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2/1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGK17LHL%252F2025-10-14%252Fimage%252F27af64a2-00ef-4418-bdfc-297f7617e5fb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GK17LHL/2025-10-14/image/27af64a2-00ef-4418-bdfc-297f7617e5fb_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2
2025-12-01 19:02:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2, skipping ID generation
2025-12-01 19:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2 with scrape type 1
2025-12-01 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2 from tracking dictionaries
2025-12-01 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2 sending to next pipeline
2025-12-01 19:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2, identifier: 116288981
2025-12-01 19:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e4165d0>
2025-12-01 19:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1a8361b-a960-5c0c-86a5-26eec748d1ec/a1a8361b-a960-5c0c-86a5-26eec748d1ec_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX73WOH%252F2025-11-12%252Fimage%252F297cf991-9b8e-4ec8-855d-da5f4de84bfb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX73WOH/2025-11-12/image/297cf991-9b8e-4ec8-855d-da5f4de84bfb_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1a8361b-a960-5c0c-86a5-26eec748d1ec
2025-12-01 19:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e424ed0>
2025-12-01 19:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bc2920f-55ca-53ab-84a8-db2242b7bc17/4bc2920f-55ca-53ab-84a8-db2242b7bc17_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAP23VKB%252F2025-11-25%252Fimage%252F73b8cc7a-bea7-4a20-b83b-06d3cb3603e7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP23VKB/2025-11-25/image/73b8cc7a-bea7-4a20-b83b-06d3cb3603e7_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4bc2920f-55ca-53ab-84a8-db2242b7bc17
2025-12-01 19:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AP23VKB/2025-11-25/image/40f55a5d-86b6-46c9-b3ed-6aa2fb02781e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117185008?view=catalogue)
2025-12-01 19:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LY74DXW/2025-11-10/image/ce74b827-ea4f-4c56-965e-aa8d2f11a5f4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117023136?view=catalogue)
2025-12-01 19:02:14 [astonbarclay.gb] INFO: Found listing with ID: 117138563
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117138563%27 HTTP/1.1" 200 None
2025-12-01 19:02:14 [astonbarclay.gb] INFO: Scrape type for 117138563: 0
2025-12-01 19:02:14 [astonbarclay.gb] INFO: Found listing with ID: 117269311
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117269311%27 HTTP/1.1" 200 None
2025-12-01 19:02:14 [astonbarclay.gb] INFO: Scrape type for 117269311: 0
2025-12-01 19:02:14 [astonbarclay.gb] INFO: Found listing with ID: 117500036
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117500036%27 HTTP/1.1" 200 None
2025-12-01 19:02:14 [astonbarclay.gb] INFO: Scrape type for 117500036: 0
2025-12-01 19:02:14 [astonbarclay.gb] INFO: Found listing with ID: 116997220
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116997220%27 HTTP/1.1" 200 None
2025-12-01 19:02:14 [astonbarclay.gb] INFO: Scrape type for 116997220: 0
2025-12-01 19:02:14 [astonbarclay.gb] INFO: Found listing with ID: 117621025
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117621025%27 HTTP/1.1" 200 None
2025-12-01 19:02:14 [astonbarclay.gb] INFO: Scrape type for 117621025: 1
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA22LMF%252F2025-11-25%252Fimage%252F35a16fbf-67d3-46e9-9086-9f914d67cc30_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA22LMF/2025-11-25/image/35a16fbf-67d3-46e9-9086-9f914d67cc30_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2 with identifier: 116288981
2025-12-01 19:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2 with identifier: 116288981
2025-12-01 19:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2 with identifier: 116288981 to the API
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/GK17LHL/2025-10-14/image/27af64a2-00ef-4418-bdfc-297f7617e5fb_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GK17LHL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116288981',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'NISSAN',
 'model': 'QASHQAI DIESEL HATCHBACK',
 'odometer': 88060,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2/1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25708,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/681955bc-daf4-499b-869f-a31e01033809_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2/1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24356,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/b0ab792c-80b6-45e4-bf7e-5c2e65c76e8e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2/1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22592,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/b2522cad-e936-469b-8465-cc454e6e210e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2/1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 20230,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/ccab1513-0561-4d33-86f5-0dc2d1ccc9ec_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2/1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42757,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/a110cd1b-3dba-4af0-9264-9bf7688d62ed_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2/1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47707,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/9b0f9adc-2807-4720-bdaa-81cf105c406d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2/1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39383,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/d3df424d-39b1-4909-ad2b-e100b16fd096_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2/1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29353,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/14bea6ed-7b1f-4dc7-a9f8-447f4375d7a2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2/1aa4afdf-5d2c-5a68-867e-bfa2b10ff6d2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41758,
             'Height': 338,
             'OriginUrl': 'https://abimg003.imgix.net/GK17LHL/2025-10-14/image/27af64a2-00ef-4418-bdfc-297f7617e5fb_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-11',
 'seller_name': 'Zuto',
 'title': 'NISSAN QASHQAI DIESEL HATCHBACK 1.6 dCi Tekna 5dr Xtronic',
 'transmission': 'automatic',
 'trim': '1.6 dCi Tekna 5dr Xtronic',
 'vin': None,
 'year': 2017}
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116288981%27 HTTP/1.1" 200 None
2025-12-01 19:02:14 [astonbarclay.gb] INFO: Saving data for 116288981: {'created_time': 1764615734.503164, 'last_price_update_time': 1764615734.503177, 'auction_closing_time': 1765285200.0}
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116288981') HTTP/1.1" 204 0
2025-12-01 19:02:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6015d0>
2025-12-01 19:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1a8361b-a960-5c0c-86a5-26eec748d1ec/a1a8361b-a960-5c0c-86a5-26eec748d1ec_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX73WOH%252F2025-11-12%252Fimage%252F776351df-9ca4-451e-b0c9-d49c1a035615_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX73WOH/2025-11-12/image/776351df-9ca4-451e-b0c9-d49c1a035615_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1a8361b-a960-5c0c-86a5-26eec748d1ec
2025-12-01 19:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e86a2d0>
2025-12-01 19:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6071c6b2-0f41-5f72-90bd-eb2c31a3d527/6071c6b2-0f41-5f72-90bd-eb2c31a3d527_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV24VUY%252F2025-11-25%252Fimage%252Fd7fe0ebe-602a-47d4-881b-f5a911f9ab25_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24VUY/2025-11-25/image/d7fe0ebe-602a-47d4-881b-f5a911f9ab25_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6071c6b2-0f41-5f72-90bd-eb2c31a3d527
2025-12-01 19:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB72MJE/2025-11-25/image/1c0d997f-0a2c-4dcd-9016-5742382d2f69_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117406754?view=catalogue)
2025-12-01 19:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX73WOH/2025-11-12/image/1aa2008d-b6f7-4728-a5aa-2bac1d7a31a7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117080670?view=catalogue)
2025-12-01 19:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA22LMF/2025-11-25/image/091deb6a-081a-45c0-b663-78520bfc5de3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117360572?view=catalogue)
2025-12-01 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX73WOH%252F2025-11-12%252Fimage%252Feb864b5a-6a54-4e10-a564-f6303ceacd1a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX73WOH/2025-11-12/image/eb864b5a-6a54-4e10-a564-f6303ceacd1a_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB72MJE%252F2025-11-25%252Fimage%252F66d8b059-aed6-4d1a-b93c-e1fa78602e94_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB72MJE/2025-11-25/image/66d8b059-aed6-4d1a-b93c-e1fa78602e94_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX75XPS%252F2025-11-12%252Fimage%252F24b95ed9-aa5b-4219-9107-14ebe5a6a862_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX75XPS/2025-11-12/image/24b95ed9-aa5b-4219-9107-14ebe5a6a862_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e684c10>
2025-12-01 19:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1/1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA22LMF%252F2025-11-25%252Fimage%252F64d7028f-57ba-41f9-ab78-8c4ca293b44d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA22LMF/2025-11-25/image/64d7028f-57ba-41f9-ab78-8c4ca293b44d_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1
2025-12-01 19:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6860d0>
2025-12-01 19:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bc2920f-55ca-53ab-84a8-db2242b7bc17/4bc2920f-55ca-53ab-84a8-db2242b7bc17_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAP23VKB%252F2025-11-25%252Fimage%252F6827af7d-8ef4-40a8-83ab-6c1644cb8ac4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP23VKB/2025-11-25/image/6827af7d-8ef4-40a8-83ab-6c1644cb8ac4_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4bc2920f-55ca-53ab-84a8-db2242b7bc17
2025-12-01 19:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6b7450>
2025-12-01 19:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc3d0ce7-7a35-5a36-9894-7cc131d3a49b/cc3d0ce7-7a35-5a36-9894-7cc131d3a49b_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLY74DXW%252F2025-11-10%252Fimage%252F53d10d18-a2e9-4433-9d71-d104163cd4c1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74DXW/2025-11-10/image/53d10d18-a2e9-4433-9d71-d104163cd4c1_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cc3d0ce7-7a35-5a36-9894-7cc131d3a49b
2025-12-01 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LY74DXW/2025-11-10/image/6cfe5c9f-f441-42a1-8969-c3b953eefa2e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117023136?view=catalogue)
2025-12-01 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA22LMF/2025-11-25/image/5edd55b9-8391-4b7a-815c-90f37d9022b8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117360572?view=catalogue)
2025-12-01 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV24VUY/2025-11-25/image/bdf87b18-11d9-46f6-afdb-9207355da6d6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117416921?view=catalogue)
2025-12-01 19:02:16 [astonbarclay.gb] INFO: Found listing with ID: 117638370
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117638370%27 HTTP/1.1" 200 None
2025-12-01 19:02:16 [astonbarclay.gb] INFO: Scrape type for 117638370: 1
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA22LMF%252F2025-11-25%252Fimage%252Fcc0eab91-5f1b-4f73-b376-2a71ecf9d74a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA22LMF/2025-11-25/image/cc0eab91-5f1b-4f73-b376-2a71ecf9d74a_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117632895?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e626510>
2025-12-01 19:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1a8361b-a960-5c0c-86a5-26eec748d1ec/a1a8361b-a960-5c0c-86a5-26eec748d1ec_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX73WOH%252F2025-11-12%252Fimage%252Fa2788cd7-85ad-4861-b146-c6dd9637c0ae_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX73WOH/2025-11-12/image/a2788cd7-85ad-4861-b146-c6dd9637c0ae_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1a8361b-a960-5c0c-86a5-26eec748d1ec
2025-12-01 19:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e623190>
2025-12-01 19:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB72MJE%252F2025-11-25%252Fimage%252Ff846d76e-d8e7-425a-b3ef-84a6036cdb7d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB72MJE/2025-11-25/image/f846d76e-d8e7-425a-b3ef-84a6036cdb7d_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b54e961e-8138-5db1-80ff-a71013059b82
2025-12-01 19:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6a09d0>
2025-12-01 19:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6071c6b2-0f41-5f72-90bd-eb2c31a3d527/6071c6b2-0f41-5f72-90bd-eb2c31a3d527_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV24VUY%252F2025-11-25%252Fimage%252F5568309f-8fd9-46c9-a927-68d10a3f2907_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24VUY/2025-11-25/image/5568309f-8fd9-46c9-a927-68d10a3f2907_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6071c6b2-0f41-5f72-90bd-eb2c31a3d527
2025-12-01 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB72MJE/2025-11-25/image/6f6e13d7-44d5-4208-94dd-38804e2ff26f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117406754?view=catalogue)
2025-12-01 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX75XPS/2025-11-12/image/ab8329dd-8848-4112-9e88-af9c4f3875ae_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117086159?view=catalogue)
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB72MJE%252F2025-11-25%252Fimage%252F428dff45-5436-4f84-b534-e595767e5952_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB72MJE/2025-11-25/image/428dff45-5436-4f84-b534-e595767e5952_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX75XPS%252F2025-11-12%252Fimage%252F391d4949-1912-4335-80e5-e4b6c01e37ab_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX75XPS/2025-11-12/image/391d4949-1912-4335-80e5-e4b6c01e37ab_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117628272?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e898f10>
2025-12-01 19:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bc2920f-55ca-53ab-84a8-db2242b7bc17/4bc2920f-55ca-53ab-84a8-db2242b7bc17_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAP23VKB%252F2025-11-25%252Fimage%252F40f55a5d-86b6-46c9-b3ed-6aa2fb02781e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP23VKB/2025-11-25/image/40f55a5d-86b6-46c9-b3ed-6aa2fb02781e_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4bc2920f-55ca-53ab-84a8-db2242b7bc17
2025-12-01 19:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e855290>
2025-12-01 19:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc3d0ce7-7a35-5a36-9894-7cc131d3a49b/cc3d0ce7-7a35-5a36-9894-7cc131d3a49b_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLY74DXW%252F2025-11-10%252Fimage%252Fce74b827-ea4f-4c56-965e-aa8d2f11a5f4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74DXW/2025-11-10/image/ce74b827-ea4f-4c56-965e-aa8d2f11a5f4_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cc3d0ce7-7a35-5a36-9894-7cc131d3a49b
2025-12-01 19:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV24VUY/2025-11-25/image/aebf380c-8ebc-48aa-9974-792df1c3fe47_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117416921?view=catalogue)
2025-12-01 19:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA22LMF/2025-11-25/image/ae69f1f2-33a1-4b7b-84d2-66e956a65723_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117360572?view=catalogue)
2025-12-01 19:02:17 [astonbarclay.gb] INFO: Found listing with ID: 117006204
2025-12-01 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117006204%27 HTTP/1.1" 200 None
2025-12-01 19:02:17 [astonbarclay.gb] INFO: Scrape type for 117006204: 0
2025-12-01 19:02:17 [astonbarclay.gb] INFO: Found listing with ID: 117623195
2025-12-01 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117623195%27 HTTP/1.1" 200 None
2025-12-01 19:02:17 [astonbarclay.gb] INFO: Scrape type for 117623195: 1
2025-12-01 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA22LMF%252F2025-11-25%252Fimage%252Fabba97c3-044c-4fa7-a26e-1db022543274_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA22LMF/2025-11-25/image/abba97c3-044c-4fa7-a26e-1db022543274_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117634646?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:02:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e610cd0>
2025-12-01 19:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB72MJE%252F2025-11-25%252Fimage%252F1c0d997f-0a2c-4dcd-9016-5742382d2f69_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB72MJE/2025-11-25/image/1c0d997f-0a2c-4dcd-9016-5742382d2f69_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b54e961e-8138-5db1-80ff-a71013059b82
2025-12-01 19:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e815b10>
2025-12-01 19:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1a8361b-a960-5c0c-86a5-26eec748d1ec/a1a8361b-a960-5c0c-86a5-26eec748d1ec_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX73WOH%252F2025-11-12%252Fimage%252F1aa2008d-b6f7-4728-a5aa-2bac1d7a31a7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX73WOH/2025-11-12/image/1aa2008d-b6f7-4728-a5aa-2bac1d7a31a7_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1a8361b-a960-5c0c-86a5-26eec748d1ec
2025-12-01 19:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e9cd1d0>
2025-12-01 19:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1/1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA22LMF%252F2025-11-25%252Fimage%252F091deb6a-081a-45c0-b663-78520bfc5de3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA22LMF/2025-11-25/image/091deb6a-081a-45c0-b663-78520bfc5de3_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1
2025-12-01 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB72MJE/2025-11-25/image/7fee3152-b978-4104-b97f-67f4b7693970_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117406754?view=catalogue)
2025-12-01 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX75XPS/2025-11-12/image/cef6c1e8-d17d-442b-85f5-48726819d6c8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117086159?view=catalogue)
2025-12-01 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV24VUY/2025-11-25/image/93ffa6d6-6b37-4cb5-8851-bec80ec86d7d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117416921?view=catalogue)
2025-12-01 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB72MJE%252F2025-11-25%252Fimage%252Fb3d66280-1e04-46b5-af63-c070920af967_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB72MJE/2025-11-25/image/b3d66280-1e04-46b5-af63-c070920af967_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX75XPS%252F2025-11-12%252Fimage%252F9e78d511-a5d2-4fd7-9087-1653bd1704fb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX75XPS/2025-11-12/image/9e78d511-a5d2-4fd7-9087-1653bd1704fb_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f506477ab10>
2025-12-01 19:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc3d0ce7-7a35-5a36-9894-7cc131d3a49b/cc3d0ce7-7a35-5a36-9894-7cc131d3a49b_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLY74DXW%252F2025-11-10%252Fimage%252F6cfe5c9f-f441-42a1-8969-c3b953eefa2e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74DXW/2025-11-10/image/6cfe5c9f-f441-42a1-8969-c3b953eefa2e_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cc3d0ce7-7a35-5a36-9894-7cc131d3a49b
2025-12-01 19:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e537f90>
2025-12-01 19:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1/1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA22LMF%252F2025-11-25%252Fimage%252F5edd55b9-8391-4b7a-815c-90f37d9022b8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA22LMF/2025-11-25/image/5edd55b9-8391-4b7a-815c-90f37d9022b8_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1
2025-12-01 19:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e536a90>
2025-12-01 19:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6071c6b2-0f41-5f72-90bd-eb2c31a3d527/6071c6b2-0f41-5f72-90bd-eb2c31a3d527_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV24VUY%252F2025-11-25%252Fimage%252Fbdf87b18-11d9-46f6-afdb-9207355da6d6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24VUY/2025-11-25/image/bdf87b18-11d9-46f6-afdb-9207355da6d6_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6071c6b2-0f41-5f72-90bd-eb2c31a3d527
2025-12-01 19:02:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117632895, 'registration': 'KE19LKY', 'account': 'WBA001', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS DIESEL HATCHBACK', 'derivative': 'A180d Sport 5dr Auto', 'mileage': 50606, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2019-05-31', 'fuel': 'Diesel', 'motExpiry': '2026-04-23', 'doors': 5, 'engineSize': 1461, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 06/20- 6K, 05/23- 27K, 04/25- 46K', 'remarks': 'VOSA STATES 20K, 27K, 35K, 46K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117632895, 'registration': 'KE19LKY', 'account': 'WBA001', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS DIESEL HATCHBACK', 'derivative': 'A180d Sport 5dr Auto', 'mileage': 50606, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2019-05-31', 'fuel': 'Diesel', 'motExpiry': '2026-04-23', 'doors': 5, 'engineSize': 1461, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 06/20- 6K, 05/23- 27K, 04/25- 46K', 'remarks': 'VOSA STATES 20K, 27K, 35K, 46K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06d4ae74-05d5-5137-9c1e-4e2600ba21d7 with identifier: 117632895
2025-12-01 19:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06d4ae74-05d5-5137-9c1e-4e2600ba21d7 with scrape type 1
2025-12-01 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 06d4ae74-05d5-5137-9c1e-4e2600ba21d7
2025-12-01 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 06d4ae74-05d5-5137-9c1e-4e2600ba21d7
2025-12-01 19:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 06d4ae74-05d5-5137-9c1e-4e2600ba21d7, identifier: 117632895
2025-12-01 19:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LY74DXW/2025-11-10/image/eca87a04-82a3-4493-87ff-0fe616ed978e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117023136?view=catalogue)
2025-12-01 19:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA22LMF/2025-11-25/image/35a16fbf-67d3-46e9-9086-9f914d67cc30_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117360572?view=catalogue)
2025-12-01 19:02:19 [astonbarclay.gb] INFO: Found listing with ID: 117122763
2025-12-01 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117122763%27 HTTP/1.1" 200 None
2025-12-01 19:02:19 [astonbarclay.gb] INFO: Scrape type for 117122763: 0
2025-12-01 19:02:19 [astonbarclay.gb] INFO: Found listing with ID: 117631988
2025-12-01 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117631988%27 HTTP/1.1" 200 None
2025-12-01 19:02:19 [astonbarclay.gb] INFO: Scrape type for 117631988: 1
2025-12-01 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA22LMF%252F2025-11-25%252Fimage%252Fe8519c3c-fa46-4b6b-855a-350ded7253d6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA22LMF/2025-11-25/image/e8519c3c-fa46-4b6b-855a-350ded7253d6_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117633313?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 06d4ae74-05d5-5137-9c1e-4e2600ba21d7 with identifier: 117632895
2025-12-01 19:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 06d4ae74-05d5-5137-9c1e-4e2600ba21d7 with identifier: 117632895
2025-12-01 19:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 06d4ae74-05d5-5137-9c1e-4e2600ba21d7 with identifier: 117632895 to the API
2025-12-01 19:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2706d4ae74-05d5-5137-9c1e-4e2600ba21d7%27 HTTP/1.1" 200 None
2025-12-01 19:02:19 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 06d4ae74-05d5-5137-9c1e-4e2600ba21d7: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:02:18 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117632895?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '06d4ae74-05d5-5137-9c1e-4e2600ba21d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KE19LKY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117632895',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS DIESEL HATCHBACK',
 'odometer': 50606,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-31',
 'seller_name': 'UKCGR',
 'title': 'MERCEDES-BENZ A CLASS DIESEL HATCHBACK A180d Sport 5dr Auto',
 'transmission': 'automatic',
 'trim': 'A180d Sport 5dr Auto',
 'vin': None,
 'year': 2019}
2025-12-01 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117632895%27 HTTP/1.1" 200 None
2025-12-01 19:02:19 [astonbarclay.gb] INFO: Saving data for 117632895: {'created_time': 1764615739.92515, 'last_price_update_time': 1764615739.925161}
2025-12-01 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117632895') HTTP/1.1" 204 0
2025-12-01 19:02:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e698490>
2025-12-01 19:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB72MJE%252F2025-11-25%252Fimage%252F6f6e13d7-44d5-4208-94dd-38804e2ff26f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB72MJE/2025-11-25/image/6f6e13d7-44d5-4208-94dd-38804e2ff26f_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b54e961e-8138-5db1-80ff-a71013059b82
2025-12-01 19:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e586610>
2025-12-01 19:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40fa02b3-6433-5a93-94dd-bccc5a18ed40/40fa02b3-6433-5a93-94dd-bccc5a18ed40_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX75XPS%252F2025-11-12%252Fimage%252Fab8329dd-8848-4112-9e88-af9c4f3875ae_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX75XPS/2025-11-12/image/ab8329dd-8848-4112-9e88-af9c4f3875ae_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40fa02b3-6433-5a93-94dd-bccc5a18ed40
2025-12-01 19:02:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117628272, 'registration': 'KO17WEX', 'account': 'WBA001', 'make': 'MERCEDES-BENZ', 'model': 'C CLASS DIESEL SALOON', 'derivative': 'C250d AMG Line Premium Plus 4dr 9G-Tronic', 'mileage': 80650, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2017-06-30', 'fuel': 'Diesel', 'motExpiry': '2025-12-16', 'doors': 4, 'engineSize': 2143, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/KO17WEX/2025-12-01/image/57212b9a-61b0-44f6-ae69-b9f36bab1ffa_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO17WEX/2025-12-01/image/a1a4d14a-c81e-4bfe-ac48-3697e10b3b51_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO17WEX/2025-12-01/image/add26511-0a91-4c36-8992-c04e8c513469_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO17WEX/2025-12-01/image/0203db56-8a30-46fc-9caf-2a95c26fe46e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO17WEX/2025-12-01/image/fd31edad-17a1-481b-a63f-aac851500c9b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO17WEX/2025-12-01/image/096d985d-f0b7-4926-ac48-c194a9376cf6_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO17WEX/2025-12-01/image/049646db-5224-4a39-bdf0-4aee6d7ca1f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO17WEX/2025-12-01/image/4574be9c-18d7-43ae-be59-d6010e5e1beb_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO17WEX/2025-12-01/image/d87afa89-f04f-427a-b49c-2c003ea09013_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO17WEX/2025-12-01/image/d42d7de0-9cb4-4c4e-a5a5-91cc07f29fe6_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 74k 68k 56k 50k', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8aa75a92-9db6-4e9b-93b1-8b89ca44c071.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117628272, 'registration': 'KO17WEX', 'account': 'WBA001', 'make': 'MERCEDES-BENZ', 'model': 'C CLASS DIESEL SALOON', 'derivative': 'C250d AMG Line Premium Plus 4dr 9G-Tronic', 'mileage': 80650, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2017-06-30', 'fuel': 'Diesel', 'motExpiry': '2025-12-16', 'doors': 4, 'engineSize': 2143, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/KO17WEX/2025-12-01/image/57212b9a-61b0-44f6-ae69-b9f36bab1ffa_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO17WEX/2025-12-01/image/a1a4d14a-c81e-4bfe-ac48-3697e10b3b51_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO17WEX/2025-12-01/image/add26511-0a91-4c36-8992-c04e8c513469_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO17WEX/2025-12-01/image/0203db56-8a30-46fc-9caf-2a95c26fe46e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO17WEX/2025-12-01/image/fd31edad-17a1-481b-a63f-aac851500c9b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO17WEX/2025-12-01/image/096d985d-f0b7-4926-ac48-c194a9376cf6_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO17WEX/2025-12-01/image/049646db-5224-4a39-bdf0-4aee6d7ca1f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO17WEX/2025-12-01/image/4574be9c-18d7-43ae-be59-d6010e5e1beb_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO17WEX/2025-12-01/image/d87afa89-f04f-427a-b49c-2c003ea09013_removebg.jpg?w=600', 'https://abimg003.imgix.net/KO17WEX/2025-12-01/image/d42d7de0-9cb4-4c4e-a5a5-91cc07f29fe6_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 74k 68k 56k 50k', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8aa75a92-9db6-4e9b-93b1-8b89ca44c071.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2820895d-4683-5acb-9ccf-a641b030a16e with identifier: 117628272
2025-12-01 19:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2820895d-4683-5acb-9ccf-a641b030a16e with scrape type 1
2025-12-01 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2820895d-4683-5acb-9ccf-a641b030a16e
2025-12-01 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKO17WEX%252F2025-12-01%252Fimage%252F57212b9a-61b0-44f6-ae69-b9f36bab1ffa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KO17WEX/2025-12-01/image/57212b9a-61b0-44f6-ae69-b9f36bab1ffa_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB72MJE/2025-11-25/image/66d8b059-aed6-4d1a-b93c-e1fa78602e94_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117406754?view=catalogue)
2025-12-01 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX75XPS/2025-11-12/image/24b95ed9-aa5b-4219-9107-14ebe5a6a862_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117086159?view=catalogue)
2025-12-01 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX73WOH/2025-11-12/image/eb864b5a-6a54-4e10-a564-f6303ceacd1a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117080670?view=catalogue)
2025-12-01 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB72MJE%252F2025-11-25%252Fimage%252Fb3e68666-76b5-4329-be30-68e52f2e2c69_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB72MJE/2025-11-25/image/b3e68666-76b5-4329-be30-68e52f2e2c69_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX75XPS%252F2025-11-12%252Fimage%252Fea09524a-2ee5-4844-b24c-c3eee26fa064_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX75XPS/2025-11-12/image/ea09524a-2ee5-4844-b24c-c3eee26fa064_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117629580?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e585a10>
2025-12-01 19:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6071c6b2-0f41-5f72-90bd-eb2c31a3d527/6071c6b2-0f41-5f72-90bd-eb2c31a3d527_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV24VUY%252F2025-11-25%252Fimage%252Faebf380c-8ebc-48aa-9974-792df1c3fe47_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24VUY/2025-11-25/image/aebf380c-8ebc-48aa-9974-792df1c3fe47_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6071c6b2-0f41-5f72-90bd-eb2c31a3d527
2025-12-01 19:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e5949d0>
2025-12-01 19:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1/1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA22LMF%252F2025-11-25%252Fimage%252Fae69f1f2-33a1-4b7b-84d2-66e956a65723_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA22LMF/2025-11-25/image/ae69f1f2-33a1-4b7b-84d2-66e956a65723_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1
2025-12-01 19:02:21 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117634646, 'registration': 'AU23OBX', 'account': 'WBA001', 'make': 'VOLKSWAGEN', 'model': 'TIGUAN DIESEL ESTATE', 'derivative': '2.0 TDI R-Line 5dr DSG', 'mileage': 12718, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2023-03-18', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/AU23OBX/2025-12-01/image/d13dfe4b-d596-4d85-ab3d-ca2cfcbb8bd1_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU23OBX/2025-12-01/image/0d70a26e-25c5-4f48-808a-1932c6706733_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU23OBX/2025-12-01/image/bc5a24ec-9b6a-439f-b251-b18e313c797b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU23OBX/2025-12-01/image/9816596c-c6d7-43d2-a414-884363cca987_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU23OBX/2025-12-01/image/0bbd359b-abd7-4cbc-96cf-54aea143b526_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU23OBX/2025-12-01/image/c020cfae-1ff5-4027-8cfc-e8fdc367e285_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU23OBX/2025-12-01/image/19f364bb-be75-4107-877a-6da8ff652d72_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU23OBX/2025-12-01/image/e5af90f2-e33e-4c3c-97ee-a6e10ff0e030_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU23OBX/2025-12-01/image/a7e4ea61-c38b-46fc-a4e4-e94d5232e13b_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/24-8k,  11/25-12k', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d0816cfc-491e-4fea-8cd8-25a39c446342.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:21 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117634646, 'registration': 'AU23OBX', 'account': 'WBA001', 'make': 'VOLKSWAGEN', 'model': 'TIGUAN DIESEL ESTATE', 'derivative': '2.0 TDI R-Line 5dr DSG', 'mileage': 12718, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2023-03-18', 'fuel': 'Diesel', 'motExpiry': None, 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/AU23OBX/2025-12-01/image/d13dfe4b-d596-4d85-ab3d-ca2cfcbb8bd1_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU23OBX/2025-12-01/image/0d70a26e-25c5-4f48-808a-1932c6706733_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU23OBX/2025-12-01/image/bc5a24ec-9b6a-439f-b251-b18e313c797b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU23OBX/2025-12-01/image/9816596c-c6d7-43d2-a414-884363cca987_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU23OBX/2025-12-01/image/0bbd359b-abd7-4cbc-96cf-54aea143b526_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU23OBX/2025-12-01/image/c020cfae-1ff5-4027-8cfc-e8fdc367e285_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU23OBX/2025-12-01/image/19f364bb-be75-4107-877a-6da8ff652d72_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU23OBX/2025-12-01/image/e5af90f2-e33e-4c3c-97ee-a6e10ff0e030_removebg.jpg?w=600', 'https://abimg003.imgix.net/AU23OBX/2025-12-01/image/a7e4ea61-c38b-46fc-a4e4-e94d5232e13b_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/24-8k,  11/25-12k', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d0816cfc-491e-4fea-8cd8-25a39c446342.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96670254-9e60-53c1-a1c3-3ccb32ebbceb with identifier: 117634646
2025-12-01 19:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96670254-9e60-53c1-a1c3-3ccb32ebbceb with scrape type 1
2025-12-01 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 96670254-9e60-53c1-a1c3-3ccb32ebbceb
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAU23OBX%252F2025-12-01%252Fimage%252Fd13dfe4b-d596-4d85-ab3d-ca2cfcbb8bd1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU23OBX/2025-12-01/image/d13dfe4b-d596-4d85-ab3d-ca2cfcbb8bd1_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AP23VKB/2025-11-25/image/6704290f-a77a-4d02-81e4-97488e185212_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117185008?view=catalogue)
2025-12-01 19:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA22LMF/2025-11-25/image/cc0eab91-5f1b-4f73-b376-2a71ecf9d74a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117360572?view=catalogue)
2025-12-01 19:02:21 [astonbarclay.gb] INFO: Found listing with ID: 117622987
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117622987%27 HTTP/1.1" 200 None
2025-12-01 19:02:21 [astonbarclay.gb] INFO: Scrape type for 117622987: 1
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA22LMF%252F2025-11-25%252Fimage%252F85b9e472-5d81-415a-a9fc-f89f07f3faf9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA22LMF/2025-11-25/image/85b9e472-5d81-415a-a9fc-f89f07f3faf9_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKO17WEX%252F2025-12-01%252Fimage%252Fa1a4d14a-c81e-4bfe-ac48-3697e10b3b51_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KO17WEX/2025-12-01/image/a1a4d14a-c81e-4bfe-ac48-3697e10b3b51_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117631748?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:02:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e9c9710>
2025-12-01 19:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB72MJE%252F2025-11-25%252Fimage%252F7fee3152-b978-4104-b97f-67f4b7693970_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB72MJE/2025-11-25/image/7fee3152-b978-4104-b97f-67f4b7693970_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b54e961e-8138-5db1-80ff-a71013059b82
2025-12-01 19:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e700490>
2025-12-01 19:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40fa02b3-6433-5a93-94dd-bccc5a18ed40/40fa02b3-6433-5a93-94dd-bccc5a18ed40_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX75XPS%252F2025-11-12%252Fimage%252Fcef6c1e8-d17d-442b-85f5-48726819d6c8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX75XPS/2025-11-12/image/cef6c1e8-d17d-442b-85f5-48726819d6c8_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 40fa02b3-6433-5a93-94dd-bccc5a18ed40
2025-12-01 19:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e700310>
2025-12-01 19:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6071c6b2-0f41-5f72-90bd-eb2c31a3d527/6071c6b2-0f41-5f72-90bd-eb2c31a3d527_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV24VUY%252F2025-11-25%252Fimage%252F93ffa6d6-6b37-4cb5-8851-bec80ec86d7d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV24VUY/2025-11-25/image/93ffa6d6-6b37-4cb5-8851-bec80ec86d7d_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6071c6b2-0f41-5f72-90bd-eb2c31a3d527
2025-12-01 19:02:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6071c6b2-0f41-5f72-90bd-eb2c31a3d527, skipping ID generation
2025-12-01 19:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6071c6b2-0f41-5f72-90bd-eb2c31a3d527 with scrape type 1
2025-12-01 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6071c6b2-0f41-5f72-90bd-eb2c31a3d527 from tracking dictionaries
2025-12-01 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6071c6b2-0f41-5f72-90bd-eb2c31a3d527 sending to next pipeline
2025-12-01 19:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6071c6b2-0f41-5f72-90bd-eb2c31a3d527, identifier: 117416921
2025-12-01 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB72MJE/2025-11-25/image/428dff45-5436-4f84-b534-e595767e5952_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117406754?view=catalogue)
2025-12-01 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX75XPS/2025-11-12/image/391d4949-1912-4335-80e5-e4b6c01e37ab_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117086159?view=catalogue)
2025-12-01 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX73WOH/2025-11-12/image/c4a878bd-782c-42f0-91ba-2574458510a0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117080670?view=catalogue)
2025-12-01 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB72MJE%252F2025-11-25%252Fimage%252F6f9dfc56-ef94-47f2-91ed-a6f16b91f58e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB72MJE/2025-11-25/image/6f9dfc56-ef94-47f2-91ed-a6f16b91f58e_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX75XPS%252F2025-11-12%252Fimage%252Fcc16b2ce-e92a-4f75-b3eb-fcf6091b4188_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX75XPS/2025-11-12/image/cc16b2ce-e92a-4f75-b3eb-fcf6091b4188_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAU23OBX%252F2025-12-01%252Fimage%252F0d70a26e-25c5-4f48-808a-1932c6706733_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU23OBX/2025-12-01/image/0d70a26e-25c5-4f48-808a-1932c6706733_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6071c6b2-0f41-5f72-90bd-eb2c31a3d527 with identifier: 117416921
2025-12-01 19:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6071c6b2-0f41-5f72-90bd-eb2c31a3d527 with identifier: 117416921
2025-12-01 19:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6071c6b2-0f41-5f72-90bd-eb2c31a3d527 with identifier: 117416921 to the API
2025-12-01 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LV24VUY/2025-11-25/image/93ffa6d6-6b37-4cb5-8851-bec80ec86d7d_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '6071c6b2-0f41-5f72-90bd-eb2c31a3d527',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LV24VUY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117416921',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'Q2 ESTATE',
 'odometer': 18895,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6071c6b2-0f41-5f72-90bd-eb2c31a3d527/6071c6b2-0f41-5f72-90bd-eb2c31a3d527_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31544,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/354b23e8-7435-4583-a6e5-98f7080e99b9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6071c6b2-0f41-5f72-90bd-eb2c31a3d527/6071c6b2-0f41-5f72-90bd-eb2c31a3d527_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32988,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/412e036c-b41a-4409-8ff2-15242e796bd8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6071c6b2-0f41-5f72-90bd-eb2c31a3d527/6071c6b2-0f41-5f72-90bd-eb2c31a3d527_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35367,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/47bf93eb-86e5-4b1e-b422-c6ab74baf2f1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6071c6b2-0f41-5f72-90bd-eb2c31a3d527/6071c6b2-0f41-5f72-90bd-eb2c31a3d527_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32232,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/e918fe75-fb1b-41c3-b0ae-de85303bd5b9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6071c6b2-0f41-5f72-90bd-eb2c31a3d527/6071c6b2-0f41-5f72-90bd-eb2c31a3d527_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29266,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/d7fe0ebe-602a-47d4-881b-f5a911f9ab25_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6071c6b2-0f41-5f72-90bd-eb2c31a3d527/6071c6b2-0f41-5f72-90bd-eb2c31a3d527_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52088,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/5568309f-8fd9-46c9-a927-68d10a3f2907_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6071c6b2-0f41-5f72-90bd-eb2c31a3d527/6071c6b2-0f41-5f72-90bd-eb2c31a3d527_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50523,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/bdf87b18-11d9-46f6-afdb-9207355da6d6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6071c6b2-0f41-5f72-90bd-eb2c31a3d527/6071c6b2-0f41-5f72-90bd-eb2c31a3d527_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43185,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/aebf380c-8ebc-48aa-9974-792df1c3fe47_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6071c6b2-0f41-5f72-90bd-eb2c31a3d527/6071c6b2-0f41-5f72-90bd-eb2c31a3d527_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31075,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV24VUY/2025-11-25/image/93ffa6d6-6b37-4cb5-8851-bec80ec86d7d_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-18',
 'seller_name': 'Motability Operations',
 'title': 'AUDI Q2 ESTATE 35 TFSI S Line 5dr S Tronic',
 'transmission': 'automatic',
 'trim': '35 TFSI S Line 5dr S Tronic',
 'vin': None,
 'year': 2024}
2025-12-01 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117416921%27 HTTP/1.1" 200 None
2025-12-01 19:02:22 [astonbarclay.gb] INFO: Saving data for 117416921: {'created_time': 1764615742.409494, 'last_price_update_time': 1764615742.409504, 'auction_closing_time': 1765792800.0}
2025-12-01 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117416921') HTTP/1.1" 204 0
2025-12-01 19:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e67a890>
2025-12-01 19:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc3d0ce7-7a35-5a36-9894-7cc131d3a49b/cc3d0ce7-7a35-5a36-9894-7cc131d3a49b_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLY74DXW%252F2025-11-10%252Fimage%252Feca87a04-82a3-4493-87ff-0fe616ed978e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74DXW/2025-11-10/image/eca87a04-82a3-4493-87ff-0fe616ed978e_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cc3d0ce7-7a35-5a36-9894-7cc131d3a49b
2025-12-01 19:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f2ee410>
2025-12-01 19:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1/1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA22LMF%252F2025-11-25%252Fimage%252F35a16fbf-67d3-46e9-9086-9f914d67cc30_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA22LMF/2025-11-25/image/35a16fbf-67d3-46e9-9086-9f914d67cc30_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1
2025-12-01 19:02:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117633313, 'registration': 'AO72GYV', 'account': 'KIN032', 'make': 'TOYOTA', 'model': 'AYGO X HATCHBACK', 'derivative': '1.0 VVT-i Edge 5dr', 'mileage': 24000, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 216}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2022-11-28', 'fuel': 'Petrol', 'motExpiry': '2026-11-27', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREEN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cdf0719c-f8bb-496c-8727-cc4fedc5cdf7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-01 19:02:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117633313, 'registration': 'AO72GYV', 'account': 'KIN032', 'make': 'TOYOTA', 'model': 'AYGO X HATCHBACK', 'derivative': '1.0 VVT-i Edge 5dr', 'mileage': 24000, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 216}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2022-11-28', 'fuel': 'Petrol', 'motExpiry': '2026-11-27', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREEN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cdf0719c-f8bb-496c-8727-cc4fedc5cdf7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-01 19:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78013d61-594c-5897-bef1-2438f77cbd0c with identifier: 117633313
2025-12-01 19:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78013d61-594c-5897-bef1-2438f77cbd0c with scrape type 1
2025-12-01 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 78013d61-594c-5897-bef1-2438f77cbd0c
2025-12-01 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 78013d61-594c-5897-bef1-2438f77cbd0c
2025-12-01 19:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 78013d61-594c-5897-bef1-2438f77cbd0c, identifier: 117633313
2025-12-01 19:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA22LMF/2025-11-25/image/abba97c3-044c-4fa7-a26e-1db022543274_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117360572?view=catalogue)
2025-12-01 19:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LY74DXW/2025-11-10/image/e5867b0b-c2c6-4b63-8993-f59574ebccd2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117023136?view=catalogue)
2025-12-01 19:02:23 [astonbarclay.gb] INFO: Found listing with ID: 117625254
2025-12-01 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117625254%27 HTTP/1.1" 200 None
2025-12-01 19:02:23 [astonbarclay.gb] INFO: Scrape type for 117625254: 1
2025-12-01 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKO17WEX%252F2025-12-01%252Fimage%252Fadd26511-0a91-4c36-8992-c04e8c513469_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KO17WEX/2025-12-01/image/add26511-0a91-4c36-8992-c04e8c513469_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117621025?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 78013d61-594c-5897-bef1-2438f77cbd0c with identifier: 117633313
2025-12-01 19:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-01 19:02:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GREEN HTTP/1.1" 200 None
2025-12-01 19:02:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-01 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-01 19:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 78013d61-594c-5897-bef1-2438f77cbd0c with identifier: 117633313
2025-12-01 19:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 78013d61-594c-5897-bef1-2438f77cbd0c with identifier: 117633313 to the API
2025-12-01 19:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2778013d61-594c-5897-bef1-2438f77cbd0c%27 HTTP/1.1" 200 None
2025-12-01 19:02:23 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 78013d61-594c-5897-bef1-2438f77cbd0c: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:02:22 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117633313?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'GREEN',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '78013d61-594c-5897-bef1-2438f77cbd0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'AO72GYV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117633313',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'TOYOTA',
 'model': 'AYGO X HATCHBACK',
 'odometer': 24000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-28',
 'seller_name': 'Kinto',
 'title': 'TOYOTA AYGO X HATCHBACK 1.0 VVT-i Edge 5dr',
 'transmission': 'manual',
 'trim': '1.0 VVT-i Edge 5dr',
 'vin': None,
 'year': 2022}
2025-12-01 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117633313%27 HTTP/1.1" 200 None
2025-12-01 19:02:23 [astonbarclay.gb] INFO: Saving data for 117633313: {'created_time': 1764615743.553093, 'last_price_update_time': 1764615743.553106}
2025-12-01 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117633313') HTTP/1.1" 204 0
2025-12-01 19:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e780a90>
2025-12-01 19:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB72MJE%252F2025-11-25%252Fimage%252F66d8b059-aed6-4d1a-b93c-e1fa78602e94_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB72MJE/2025-11-25/image/66d8b059-aed6-4d1a-b93c-e1fa78602e94_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b54e961e-8138-5db1-80ff-a71013059b82
2025-12-01 19:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f2a8650>
2025-12-01 19:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40fa02b3-6433-5a93-94dd-bccc5a18ed40/40fa02b3-6433-5a93-94dd-bccc5a18ed40_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX75XPS%252F2025-11-12%252Fimage%252F24b95ed9-aa5b-4219-9107-14ebe5a6a862_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX75XPS/2025-11-12/image/24b95ed9-aa5b-4219-9107-14ebe5a6a862_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 40fa02b3-6433-5a93-94dd-bccc5a18ed40
2025-12-01 19:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e8ad0d0>
2025-12-01 19:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1a8361b-a960-5c0c-86a5-26eec748d1ec/a1a8361b-a960-5c0c-86a5-26eec748d1ec_image_9.jpg HTTP/1.1" 201 0
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX73WOH%252F2025-11-12%252Fimage%252Feb864b5a-6a54-4e10-a564-f6303ceacd1a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX73WOH/2025-11-12/image/eb864b5a-6a54-4e10-a564-f6303ceacd1a_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a1a8361b-a960-5c0c-86a5-26eec748d1ec
2025-12-01 19:02:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117629580, 'registration': 'LX69UED', 'account': 'WBA001', 'make': 'NISSAN', 'model': 'QASHQAI DIESEL HATCHBACK', 'derivative': '1.5 dCi 115 Acenta Premium 5dr DCT', 'mileage': 43853, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2019-09-21', 'fuel': 'Diesel', 'motExpiry': '2026-01-23', 'doors': 5, 'engineSize': 1461, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LX69UED/2025-12-01/image/b91b8faf-e762-4aca-9526-c67ca8fee65c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/976aeb19-50f5-4c27-8d21-ca7ec63a40ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/3a8ff86f-9f4f-4bf1-8030-986b6364bee6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/a3896bca-0380-40a4-8bce-fe581f28d386_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/1094ac23-c88f-4b33-81a0-245b373faf84_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/1949faf7-250a-4f3f-a743-ce03531ac39e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/22848df7-7559-41c6-af64-ae33558efb1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/3060d354-32c1-43e1-a34f-327d14864a9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/a82b318a-d426-4d88-bf0e-d0cea6434722_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/4f05a703-eb66-4353-8185-cbd14f32f981_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/5b910150-0143-46ba-8e53-2ca299f7768f_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 14K, 16K, 23K, 37K', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/53de4c3e-ee7e-42d2-9568-d1b70c00e1c0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117629580, 'registration': 'LX69UED', 'account': 'WBA001', 'make': 'NISSAN', 'model': 'QASHQAI DIESEL HATCHBACK', 'derivative': '1.5 dCi 115 Acenta Premium 5dr DCT', 'mileage': 43853, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2019-09-21', 'fuel': 'Diesel', 'motExpiry': '2026-01-23', 'doors': 5, 'engineSize': 1461, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LX69UED/2025-12-01/image/b91b8faf-e762-4aca-9526-c67ca8fee65c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/976aeb19-50f5-4c27-8d21-ca7ec63a40ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/3a8ff86f-9f4f-4bf1-8030-986b6364bee6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/a3896bca-0380-40a4-8bce-fe581f28d386_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/1094ac23-c88f-4b33-81a0-245b373faf84_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/1949faf7-250a-4f3f-a743-ce03531ac39e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/22848df7-7559-41c6-af64-ae33558efb1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/3060d354-32c1-43e1-a34f-327d14864a9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/a82b318a-d426-4d88-bf0e-d0cea6434722_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/4f05a703-eb66-4353-8185-cbd14f32f981_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/5b910150-0143-46ba-8e53-2ca299f7768f_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 14K, 16K, 23K, 37K', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/53de4c3e-ee7e-42d2-9568-d1b70c00e1c0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d59180b-d1ec-5c2b-9f81-876a812e1c8f with identifier: 117629580
2025-12-01 19:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d59180b-d1ec-5c2b-9f81-876a812e1c8f with scrape type 1
2025-12-01 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item 9d59180b-d1ec-5c2b-9f81-876a812e1c8f
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX69UED%252F2025-12-01%252Fimage%252Fb91b8faf-e762-4aca-9526-c67ca8fee65c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX69UED/2025-12-01/image/b91b8faf-e762-4aca-9526-c67ca8fee65c_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX75XPS/2025-11-12/image/9e78d511-a5d2-4fd7-9087-1653bd1704fb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117086159?view=catalogue)
2025-12-01 19:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB72MJE/2025-11-25/image/b3d66280-1e04-46b5-af63-c070920af967_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117406754?view=catalogue)
2025-12-01 19:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AP23VKB/2025-11-25/image/4c7837b0-f5ad-4a33-b31a-c23f0903389c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117185008?view=catalogue)
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLB72MJE%252F2025-11-25%252Fimage%252Fe7c57c5d-c232-4dbb-8965-083f63171029_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB72MJE/2025-11-25/image/e7c57c5d-c232-4dbb-8965-083f63171029_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX75XPS%252F2025-11-12%252Fimage%252F717c3857-ecc0-495c-9106-1f4981935b92_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX75XPS/2025-11-12/image/717c3857-ecc0-495c-9106-1f4981935b92_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAU23OBX%252F2025-12-01%252Fimage%252Fbc5a24ec-9b6a-439f-b251-b18e313c797b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU23OBX/2025-12-01/image/bc5a24ec-9b6a-439f-b251-b18e313c797b_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e70b8d0>
2025-12-01 19:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bc2920f-55ca-53ab-84a8-db2242b7bc17/4bc2920f-55ca-53ab-84a8-db2242b7bc17_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAP23VKB%252F2025-11-25%252Fimage%252F6704290f-a77a-4d02-81e4-97488e185212_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP23VKB/2025-11-25/image/6704290f-a77a-4d02-81e4-97488e185212_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4bc2920f-55ca-53ab-84a8-db2242b7bc17
2025-12-01 19:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e97b5d0>
2025-12-01 19:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1/1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA22LMF%252F2025-11-25%252Fimage%252Fcc0eab91-5f1b-4f73-b376-2a71ecf9d74a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA22LMF/2025-11-25/image/cc0eab91-5f1b-4f73-b376-2a71ecf9d74a_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1
2025-12-01 19:02:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117631748, 'registration': 'SL18LNE', 'account': 'WBA001', 'make': 'MERCEDES-BENZ', 'model': 'GLA DIESEL HATCHBACK', 'derivative': 'GLA 200d Sport Executive 5dr', 'mileage': 94427, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2018-04-30', 'fuel': 'Diesel', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 2143, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'SPARE KEY - SD CARD - VOSA STATES  93k 71k 60k 49k', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117631748, 'registration': 'SL18LNE', 'account': 'WBA001', 'make': 'MERCEDES-BENZ', 'model': 'GLA DIESEL HATCHBACK', 'derivative': 'GLA 200d Sport Executive 5dr', 'mileage': 94427, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2018-04-30', 'fuel': 'Diesel', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 2143, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'SPARE KEY - SD CARD - VOSA STATES  93k 71k 60k 49k', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c56fd788-4851-56f1-9478-94ea4c43dc06 with identifier: 117631748
2025-12-01 19:02:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c56fd788-4851-56f1-9478-94ea4c43dc06 with scrape type 1
2025-12-01 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item c56fd788-4851-56f1-9478-94ea4c43dc06
2025-12-01 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item c56fd788-4851-56f1-9478-94ea4c43dc06
2025-12-01 19:02:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c56fd788-4851-56f1-9478-94ea4c43dc06, identifier: 117631748
2025-12-01 19:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX73WOH/2025-11-12/image/eb300b4c-adb3-4a28-a652-603e10241439_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117080670?view=catalogue)
2025-12-01 19:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KO17WEX/2025-12-01/image/57212b9a-61b0-44f6-ae69-b9f36bab1ffa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117628272?view=catalogue)
2025-12-01 19:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA22LMF/2025-11-25/image/e8519c3c-fa46-4b6b-855a-350ded7253d6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117360572?view=catalogue)
2025-12-01 19:02:25 [astonbarclay.gb] INFO: Found listing with ID: 117632412
2025-12-01 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117632412%27 HTTP/1.1" 200 None
2025-12-01 19:02:25 [astonbarclay.gb] INFO: Scrape type for 117632412: 1
2025-12-01 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKO17WEX%252F2025-12-01%252Fimage%252F0203db56-8a30-46fc-9caf-2a95c26fe46e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KO17WEX/2025-12-01/image/0203db56-8a30-46fc-9caf-2a95c26fe46e_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX69UED%252F2025-12-01%252Fimage%252F976aeb19-50f5-4c27-8d21-ca7ec63a40ca_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX69UED/2025-12-01/image/976aeb19-50f5-4c27-8d21-ca7ec63a40ca_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117638370?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c56fd788-4851-56f1-9478-94ea4c43dc06 with identifier: 117631748
2025-12-01 19:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c56fd788-4851-56f1-9478-94ea4c43dc06 with identifier: 117631748
2025-12-01 19:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 151965 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151965
2025-12-01 19:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c56fd788-4851-56f1-9478-94ea4c43dc06 spider: astonbarclay.gb
2025-12-01 19:02:25 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: c56fd788-4851-56f1-9478-94ea4c43dc06 due to rule: high_mileage_for_country.json, error: 151965 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151965
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'c56fd788-4851-56f1-9478-94ea4c43dc06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SL18LNE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117631748',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'GLA DIESEL HATCHBACK',
 'odometer': 94427,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-30',
 'seller_name': 'UKCGR',
 'title': 'MERCEDES-BENZ GLA DIESEL HATCHBACK GLA 200d Sport Executive 5dr',
 'transmission': 'manual',
 'trim': 'GLA 200d Sport Executive 5dr',
 'vin': None,
 'year': 2018}
2025-12-01 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117631748%27 HTTP/1.1" 200 None
2025-12-01 19:02:25 [astonbarclay.gb] INFO: Saving data for 117631748: {'created_time': 1764615745.418448, 'last_price_update_time': 1764615745.418459}
2025-12-01 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117631748') HTTP/1.1" 204 0
2025-12-01 19:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f2953d0>
2025-12-01 19:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB72MJE%252F2025-11-25%252Fimage%252F428dff45-5436-4f84-b534-e595767e5952_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB72MJE/2025-11-25/image/428dff45-5436-4f84-b534-e595767e5952_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b54e961e-8138-5db1-80ff-a71013059b82
2025-12-01 19:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e5d2e90>
2025-12-01 19:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40fa02b3-6433-5a93-94dd-bccc5a18ed40/40fa02b3-6433-5a93-94dd-bccc5a18ed40_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX75XPS%252F2025-11-12%252Fimage%252F391d4949-1912-4335-80e5-e4b6c01e37ab_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX75XPS/2025-11-12/image/391d4949-1912-4335-80e5-e4b6c01e37ab_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 40fa02b3-6433-5a93-94dd-bccc5a18ed40
2025-12-01 19:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e8fa7d0>
2025-12-01 19:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1a8361b-a960-5c0c-86a5-26eec748d1ec/a1a8361b-a960-5c0c-86a5-26eec748d1ec_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX73WOH%252F2025-11-12%252Fimage%252Fc4a878bd-782c-42f0-91ba-2574458510a0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX73WOH/2025-11-12/image/c4a878bd-782c-42f0-91ba-2574458510a0_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a1a8361b-a960-5c0c-86a5-26eec748d1ec
2025-12-01 19:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX75XPS/2025-11-12/image/ea09524a-2ee5-4844-b24c-c3eee26fa064_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117086159?view=catalogue)
2025-12-01 19:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AU23OBX/2025-12-01/image/d13dfe4b-d596-4d85-ab3d-ca2cfcbb8bd1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634646?view=catalogue)
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAU23OBX%252F2025-12-01%252Fimage%252F9816596c-c6d7-43d2-a414-884363cca987_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU23OBX/2025-12-01/image/9816596c-c6d7-43d2-a414-884363cca987_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f50644045d0>
2025-12-01 19:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1/1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA22LMF%252F2025-11-25%252Fimage%252Fabba97c3-044c-4fa7-a26e-1db022543274_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA22LMF/2025-11-25/image/abba97c3-044c-4fa7-a26e-1db022543274_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1
2025-12-01 19:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e424bd0>
2025-12-01 19:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc3d0ce7-7a35-5a36-9894-7cc131d3a49b/cc3d0ce7-7a35-5a36-9894-7cc131d3a49b_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLY74DXW%252F2025-11-10%252Fimage%252Fe5867b0b-c2c6-4b63-8993-f59574ebccd2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74DXW/2025-11-10/image/e5867b0b-c2c6-4b63-8993-f59574ebccd2_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cc3d0ce7-7a35-5a36-9894-7cc131d3a49b
2025-12-01 19:02:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117621025, 'registration': 'DA68HHG', 'account': 'WBA001', 'make': 'SKODA', 'model': 'KODIAQ ESTATE', 'derivative': '1.5 TSI Edition 5dr DSG [7 Seat]', 'mileage': 62846, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2018-11-27', 'fuel': 'Petrol', 'motExpiry': '2026-03-19', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DA68HHG/2025-12-01/image/e20953c5-178e-4304-89c3-a85f9a2f5205_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA68HHG/2025-12-01/image/0fd9ca43-0a7d-4874-bbfe-542172157475_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA68HHG/2025-12-01/image/8f3f792e-ab1a-4b82-bd86-c639772865ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA68HHG/2025-12-01/image/30a8f0d6-17d2-410d-8556-ffe1b5e48fd6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA68HHG/2025-12-01/image/83e19e44-00c2-4c64-8bd8-eaf6a2556ff8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA68HHG/2025-12-01/image/15487dc9-69a1-476d-a8c4-376f906c5ab1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA68HHG/2025-12-01/image/ae4922ab-7021-4197-a061-721d2ae60777_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA68HHG/2025-12-01/image/6ad03bcc-9401-477d-b335-b28bff4193a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA68HHG/2025-12-01/image/e3946526-6c75-400c-81ff-fd486762d859_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA68HHG/2025-12-01/image/37d2ad81-77e1-4637-b991-4b8a001ad17f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 11/21-23k,  11/22-33k,  11/25-62k', 'remarks': 'SPARE KEY - VOSA STATES  56k 45k 33k 23k', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/41ab6d96-ba68-458f-8839-0982b74e5a4d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117621025, 'registration': 'DA68HHG', 'account': 'WBA001', 'make': 'SKODA', 'model': 'KODIAQ ESTATE', 'derivative': '1.5 TSI Edition 5dr DSG [7 Seat]', 'mileage': 62846, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2018-11-27', 'fuel': 'Petrol', 'motExpiry': '2026-03-19', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DA68HHG/2025-12-01/image/e20953c5-178e-4304-89c3-a85f9a2f5205_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA68HHG/2025-12-01/image/0fd9ca43-0a7d-4874-bbfe-542172157475_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA68HHG/2025-12-01/image/8f3f792e-ab1a-4b82-bd86-c639772865ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA68HHG/2025-12-01/image/30a8f0d6-17d2-410d-8556-ffe1b5e48fd6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA68HHG/2025-12-01/image/83e19e44-00c2-4c64-8bd8-eaf6a2556ff8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA68HHG/2025-12-01/image/15487dc9-69a1-476d-a8c4-376f906c5ab1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA68HHG/2025-12-01/image/ae4922ab-7021-4197-a061-721d2ae60777_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA68HHG/2025-12-01/image/6ad03bcc-9401-477d-b335-b28bff4193a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA68HHG/2025-12-01/image/e3946526-6c75-400c-81ff-fd486762d859_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA68HHG/2025-12-01/image/37d2ad81-77e1-4637-b991-4b8a001ad17f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 11/21-23k,  11/22-33k,  11/25-62k', 'remarks': 'SPARE KEY - VOSA STATES  56k 45k 33k 23k', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/41ab6d96-ba68-458f-8839-0982b74e5a4d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8b3e037-7659-53a6-8aac-f95cdcbf00a1 with identifier: 117621025
2025-12-01 19:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8b3e037-7659-53a6-8aac-f95cdcbf00a1 with scrape type 1
2025-12-01 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a8b3e037-7659-53a6-8aac-f95cdcbf00a1
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDA68HHG%252F2025-12-01%252Fimage%252Fe20953c5-178e-4304-89c3-a85f9a2f5205_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA68HHG/2025-12-01/image/e20953c5-178e-4304-89c3-a85f9a2f5205_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KO17WEX/2025-12-01/image/a1a4d14a-c81e-4bfe-ac48-3697e10b3b51_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117628272?view=catalogue)
2025-12-01 19:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB72MJE/2025-11-25/image/b3e68666-76b5-4329-be30-68e52f2e2c69_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117406754?view=catalogue)
2025-12-01 19:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AP23VKB/2025-11-25/image/b2fd1c98-6d01-4cfd-abb7-8fe2365fc477_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117185008?view=catalogue)
2025-12-01 19:02:26 [astonbarclay.gb] INFO: Found listing with ID: 117625569
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117625569%27 HTTP/1.1" 200 None
2025-12-01 19:02:26 [astonbarclay.gb] INFO: Scrape type for 117625569: 1
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKO17WEX%252F2025-12-01%252Fimage%252Ffd31edad-17a1-481b-a63f-aac851500c9b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KO17WEX/2025-12-01/image/fd31edad-17a1-481b-a63f-aac851500c9b_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX69UED%252F2025-12-01%252Fimage%252F3a8ff86f-9f4f-4bf1-8030-986b6364bee6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX69UED/2025-12-01/image/3a8ff86f-9f4f-4bf1-8030-986b6364bee6_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e9b8d10>
2025-12-01 19:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40fa02b3-6433-5a93-94dd-bccc5a18ed40/40fa02b3-6433-5a93-94dd-bccc5a18ed40_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX75XPS%252F2025-11-12%252Fimage%252F9e78d511-a5d2-4fd7-9087-1653bd1704fb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX75XPS/2025-11-12/image/9e78d511-a5d2-4fd7-9087-1653bd1704fb_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 40fa02b3-6433-5a93-94dd-bccc5a18ed40
2025-12-01 19:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f223410>
2025-12-01 19:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB72MJE%252F2025-11-25%252Fimage%252Fb3d66280-1e04-46b5-af63-c070920af967_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB72MJE/2025-11-25/image/b3d66280-1e04-46b5-af63-c070920af967_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b54e961e-8138-5db1-80ff-a71013059b82
2025-12-01 19:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e9c2610>
2025-12-01 19:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bc2920f-55ca-53ab-84a8-db2242b7bc17/4bc2920f-55ca-53ab-84a8-db2242b7bc17_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAP23VKB%252F2025-11-25%252Fimage%252F4c7837b0-f5ad-4a33-b31a-c23f0903389c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP23VKB/2025-11-25/image/4c7837b0-f5ad-4a33-b31a-c23f0903389c_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4bc2920f-55ca-53ab-84a8-db2242b7bc17
2025-12-01 19:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AU23OBX/2025-12-01/image/0d70a26e-25c5-4f48-808a-1932c6706733_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634646?view=catalogue)
2025-12-01 19:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX75XPS/2025-11-12/image/cc16b2ce-e92a-4f75-b3eb-fcf6091b4188_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117086159?view=catalogue)
2025-12-01 19:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA22LMF/2025-11-25/image/85b9e472-5d81-415a-a9fc-f89f07f3faf9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117360572?view=catalogue)
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAU23OBX%252F2025-12-01%252Fimage%252F0bbd359b-abd7-4cbc-96cf-54aea143b526_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU23OBX/2025-12-01/image/0bbd359b-abd7-4cbc-96cf-54aea143b526_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDA68HHG%252F2025-12-01%252Fimage%252F0fd9ca43-0a7d-4874-bbfe-542172157475_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA68HHG/2025-12-01/image/0fd9ca43-0a7d-4874-bbfe-542172157475_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e84bd50>
2025-12-01 19:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1a8361b-a960-5c0c-86a5-26eec748d1ec/a1a8361b-a960-5c0c-86a5-26eec748d1ec_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX73WOH%252F2025-11-12%252Fimage%252Feb300b4c-adb3-4a28-a652-603e10241439_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX73WOH/2025-11-12/image/eb300b4c-adb3-4a28-a652-603e10241439_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a1a8361b-a960-5c0c-86a5-26eec748d1ec
2025-12-01 19:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f262310>
2025-12-01 19:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2820895d-4683-5acb-9ccf-a641b030a16e/2820895d-4683-5acb-9ccf-a641b030a16e_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKO17WEX%252F2025-12-01%252Fimage%252F57212b9a-61b0-44f6-ae69-b9f36bab1ffa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KO17WEX/2025-12-01/image/57212b9a-61b0-44f6-ae69-b9f36bab1ffa_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2820895d-4683-5acb-9ccf-a641b030a16e
2025-12-01 19:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e41b150>
2025-12-01 19:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1/1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA22LMF%252F2025-11-25%252Fimage%252Fe8519c3c-fa46-4b6b-855a-350ded7253d6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA22LMF/2025-11-25/image/e8519c3c-fa46-4b6b-855a-350ded7253d6_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1
2025-12-01 19:02:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117638370, 'registration': 'WM65NFL', 'account': 'WBA001', 'make': 'FORD', 'model': 'S-MAX DIESEL ESTATE', 'derivative': '2.0 TDCi 180 Titanium 5dr Powershift', 'mileage': 111808, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2016-01-29', 'fuel': 'Diesel', 'motExpiry': '2026-01-28', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WM65NFL/2025-12-01/image/b29ba2d9-5cb9-46fd-9600-0f8005abb06d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/e0a74c21-41e5-4ee6-9d3a-c19a287d16bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/99baec5d-3d0f-4887-b275-75305120f659_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/82bdc247-4e48-4f4f-b881-d2d364700ca5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/90174c2c-176e-4233-9083-b49fc86221ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/49e2ba5e-3361-4707-91a2-fd86aba16894_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/cb1377ee-50e8-4c26-b3df-c625d437a5c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/4cd35509-48c9-402a-add6-77196dc6cfe1_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/faba0797-2bf4-434a-9bcc-9cb6ac36d761_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/29f2f161-cc7f-494e-be66-5c5f7a1fdc3f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 08/20-50k,  03/23-70k,  02/24-79k,', 'remarks': 'SPARE KEY - SD CARD - VOSA STATES 98k 79k 69k 60k', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6ae92260-fd20-45d0-9790-89c03a89d22c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117638370, 'registration': 'WM65NFL', 'account': 'WBA001', 'make': 'FORD', 'model': 'S-MAX DIESEL ESTATE', 'derivative': '2.0 TDCi 180 Titanium 5dr Powershift', 'mileage': 111808, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2016-01-29', 'fuel': 'Diesel', 'motExpiry': '2026-01-28', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WM65NFL/2025-12-01/image/b29ba2d9-5cb9-46fd-9600-0f8005abb06d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/e0a74c21-41e5-4ee6-9d3a-c19a287d16bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/99baec5d-3d0f-4887-b275-75305120f659_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/82bdc247-4e48-4f4f-b881-d2d364700ca5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/90174c2c-176e-4233-9083-b49fc86221ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/49e2ba5e-3361-4707-91a2-fd86aba16894_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/cb1377ee-50e8-4c26-b3df-c625d437a5c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/4cd35509-48c9-402a-add6-77196dc6cfe1_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/faba0797-2bf4-434a-9bcc-9cb6ac36d761_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/29f2f161-cc7f-494e-be66-5c5f7a1fdc3f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 08/20-50k,  03/23-70k,  02/24-79k,', 'remarks': 'SPARE KEY - SD CARD - VOSA STATES 98k 79k 69k 60k', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6ae92260-fd20-45d0-9790-89c03a89d22c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8860decc-d092-5183-b3ca-b40ba3560e46 with identifier: 117638370
2025-12-01 19:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8860decc-d092-5183-b3ca-b40ba3560e46 with scrape type 1
2025-12-01 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8860decc-d092-5183-b3ca-b40ba3560e46
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM65NFL%252F2025-12-01%252Fimage%252Fb29ba2d9-5cb9-46fd-9600-0f8005abb06d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM65NFL/2025-12-01/image/b29ba2d9-5cb9-46fd-9600-0f8005abb06d_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB72MJE/2025-11-25/image/6f9dfc56-ef94-47f2-91ed-a6f16b91f58e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117406754?view=catalogue)
2025-12-01 19:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX69UED/2025-12-01/image/b91b8faf-e762-4aca-9526-c67ca8fee65c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117629580?view=catalogue)
2025-12-01 19:02:28 [astonbarclay.gb] INFO: Found listing with ID: 117316133
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117316133%27 HTTP/1.1" 200 None
2025-12-01 19:02:28 [astonbarclay.gb] INFO: Scrape type for 117316133: 0
2025-12-01 19:02:28 [astonbarclay.gb] INFO: Found listing with ID: 117407455
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407455%27 HTTP/1.1" 200 None
2025-12-01 19:02:28 [astonbarclay.gb] INFO: Scrape type for 117407455: 0
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKO17WEX%252F2025-12-01%252Fimage%252F096d985d-f0b7-4926-ac48-c194a9376cf6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KO17WEX/2025-12-01/image/096d985d-f0b7-4926-ac48-c194a9376cf6_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX69UED%252F2025-12-01%252Fimage%252Fa3896bca-0380-40a4-8bce-fe581f28d386_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX69UED/2025-12-01/image/a3896bca-0380-40a4-8bce-fe581f28d386_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e66d310>
2025-12-01 19:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40fa02b3-6433-5a93-94dd-bccc5a18ed40/40fa02b3-6433-5a93-94dd-bccc5a18ed40_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX75XPS%252F2025-11-12%252Fimage%252Fea09524a-2ee5-4844-b24c-c3eee26fa064_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX75XPS/2025-11-12/image/ea09524a-2ee5-4844-b24c-c3eee26fa064_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 40fa02b3-6433-5a93-94dd-bccc5a18ed40
2025-12-01 19:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e8fa090>
2025-12-01 19:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96670254-9e60-53c1-a1c3-3ccb32ebbceb/96670254-9e60-53c1-a1c3-3ccb32ebbceb_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAU23OBX%252F2025-12-01%252Fimage%252Fd13dfe4b-d596-4d85-ab3d-ca2cfcbb8bd1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU23OBX/2025-12-01/image/d13dfe4b-d596-4d85-ab3d-ca2cfcbb8bd1_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96670254-9e60-53c1-a1c3-3ccb32ebbceb
2025-12-01 19:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX75XPS/2025-11-12/image/717c3857-ecc0-495c-9106-1f4981935b92_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117086159?view=catalogue)
2025-12-01 19:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AU23OBX/2025-12-01/image/bc5a24ec-9b6a-439f-b251-b18e313c797b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634646?view=catalogue)
2025-12-01 19:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KO17WEX/2025-12-01/image/add26511-0a91-4c36-8992-c04e8c513469_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117628272?view=catalogue)
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAU23OBX%252F2025-12-01%252Fimage%252Fc020cfae-1ff5-4027-8cfc-e8fdc367e285_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU23OBX/2025-12-01/image/c020cfae-1ff5-4027-8cfc-e8fdc367e285_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDA68HHG%252F2025-12-01%252Fimage%252F8f3f792e-ab1a-4b82-bd86-c639772865ab_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA68HHG/2025-12-01/image/8f3f792e-ab1a-4b82-bd86-c639772865ab_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM65NFL%252F2025-12-01%252Fimage%252Fe0a74c21-41e5-4ee6-9d3a-c19a287d16bd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM65NFL/2025-12-01/image/e0a74c21-41e5-4ee6-9d3a-c19a287d16bd_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e624d90>
2025-12-01 19:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2820895d-4683-5acb-9ccf-a641b030a16e/2820895d-4683-5acb-9ccf-a641b030a16e_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKO17WEX%252F2025-12-01%252Fimage%252Fa1a4d14a-c81e-4bfe-ac48-3697e10b3b51_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KO17WEX/2025-12-01/image/a1a4d14a-c81e-4bfe-ac48-3697e10b3b51_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2820895d-4683-5acb-9ccf-a641b030a16e
2025-12-01 19:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e98f490>
2025-12-01 19:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB72MJE%252F2025-11-25%252Fimage%252Fb3e68666-76b5-4329-be30-68e52f2e2c69_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB72MJE/2025-11-25/image/b3e68666-76b5-4329-be30-68e52f2e2c69_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b54e961e-8138-5db1-80ff-a71013059b82
2025-12-01 19:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e61e6d0>
2025-12-01 19:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bc2920f-55ca-53ab-84a8-db2242b7bc17/4bc2920f-55ca-53ab-84a8-db2242b7bc17_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAP23VKB%252F2025-11-25%252Fimage%252Fb2fd1c98-6d01-4cfd-abb7-8fe2365fc477_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP23VKB/2025-11-25/image/b2fd1c98-6d01-4cfd-abb7-8fe2365fc477_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4bc2920f-55ca-53ab-84a8-db2242b7bc17
2025-12-01 19:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KO17WEX/2025-12-01/image/0203db56-8a30-46fc-9caf-2a95c26fe46e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117628272?view=catalogue)
2025-12-01 19:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB72MJE/2025-11-25/image/e7c57c5d-c232-4dbb-8965-083f63171029_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117406754?view=catalogue)
2025-12-01 19:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX69UED/2025-12-01/image/976aeb19-50f5-4c27-8d21-ca7ec63a40ca_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117629580?view=catalogue)
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKO17WEX%252F2025-12-01%252Fimage%252F049646db-5224-4a39-bdf0-4aee6d7ca1f5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KO17WEX/2025-12-01/image/049646db-5224-4a39-bdf0-4aee6d7ca1f5_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX69UED%252F2025-12-01%252Fimage%252F1094ac23-c88f-4b33-81a0-245b373faf84_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX69UED/2025-12-01/image/1094ac23-c88f-4b33-81a0-245b373faf84_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5064a92850>
2025-12-01 19:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96670254-9e60-53c1-a1c3-3ccb32ebbceb/96670254-9e60-53c1-a1c3-3ccb32ebbceb_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAU23OBX%252F2025-12-01%252Fimage%252F0d70a26e-25c5-4f48-808a-1932c6706733_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU23OBX/2025-12-01/image/0d70a26e-25c5-4f48-808a-1932c6706733_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 96670254-9e60-53c1-a1c3-3ccb32ebbceb
2025-12-01 19:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5064806950>
2025-12-01 19:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40fa02b3-6433-5a93-94dd-bccc5a18ed40/40fa02b3-6433-5a93-94dd-bccc5a18ed40_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX75XPS%252F2025-11-12%252Fimage%252Fcc16b2ce-e92a-4f75-b3eb-fcf6091b4188_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX75XPS/2025-11-12/image/cc16b2ce-e92a-4f75-b3eb-fcf6091b4188_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 40fa02b3-6433-5a93-94dd-bccc5a18ed40
2025-12-01 19:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e98df10>
2025-12-01 19:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1/1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA22LMF%252F2025-11-25%252Fimage%252F85b9e472-5d81-415a-a9fc-f89f07f3faf9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA22LMF/2025-11-25/image/85b9e472-5d81-415a-a9fc-f89f07f3faf9_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1
2025-12-01 19:02:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1, skipping ID generation
2025-12-01 19:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1 with scrape type 1
2025-12-01 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1 from tracking dictionaries
2025-12-01 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1 sending to next pipeline
2025-12-01 19:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1, identifier: 117360572
2025-12-01 19:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DA68HHG/2025-12-01/image/e20953c5-178e-4304-89c3-a85f9a2f5205_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117621025?view=catalogue)
2025-12-01 19:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AU23OBX/2025-12-01/image/9816596c-c6d7-43d2-a414-884363cca987_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634646?view=catalogue)
2025-12-01 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAU23OBX%252F2025-12-01%252Fimage%252F19f364bb-be75-4107-877a-6da8ff652d72_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU23OBX/2025-12-01/image/19f364bb-be75-4107-877a-6da8ff652d72_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDA68HHG%252F2025-12-01%252Fimage%252F30a8f0d6-17d2-410d-8556-ffe1b5e48fd6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA68HHG/2025-12-01/image/30a8f0d6-17d2-410d-8556-ffe1b5e48fd6_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM65NFL%252F2025-12-01%252Fimage%252F99baec5d-3d0f-4887-b275-75305120f659_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM65NFL/2025-12-01/image/99baec5d-3d0f-4887-b275-75305120f659_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1 with identifier: 117360572
2025-12-01 19:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1 with identifier: 117360572
2025-12-01 19:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1 with identifier: 117360572 to the API
2025-12-01 19:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EA22LMF/2025-11-25/image/85b9e472-5d81-415a-a9fc-f89f07f3faf9_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EA22LMF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117360572',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'RENAULT',
 'model': 'ARKANA ESTATE',
 'odometer': 37613,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1/1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43964,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/64d7028f-57ba-41f9-ab78-8c4ca293b44d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1/1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45430,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/091deb6a-081a-45c0-b663-78520bfc5de3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1/1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41500,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/5edd55b9-8391-4b7a-815c-90f37d9022b8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1/1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47741,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/ae69f1f2-33a1-4b7b-84d2-66e956a65723_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1/1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33414,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/35a16fbf-67d3-46e9-9086-9f914d67cc30_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1/1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59038,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/cc0eab91-5f1b-4f73-b376-2a71ecf9d74a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1/1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44054,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/abba97c3-044c-4fa7-a26e-1db022543274_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1/1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40489,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/e8519c3c-fa46-4b6b-855a-350ded7253d6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1/1c741c93-0d83-5fd1-b527-c8f0b4e4c0e1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57288,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA22LMF/2025-11-25/image/85b9e472-5d81-415a-a9fc-f89f07f3faf9_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-20',
 'seller_name': 'Motability Operations',
 'title': 'RENAULT ARKANA ESTATE 1.6 E-TECH Hybrid 145 R.S. Line 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6 E-TECH Hybrid 145 R.S. Line 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-01 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117360572%27 HTTP/1.1" 200 None
2025-12-01 19:02:33 [astonbarclay.gb] INFO: Saving data for 117360572: {'created_time': 1764615753.077162, 'last_price_update_time': 1764615753.077173, 'auction_closing_time': 1765792800.0}
2025-12-01 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117360572') HTTP/1.1" 204 0
2025-12-01 19:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e5de550>
2025-12-01 19:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB72MJE%252F2025-11-25%252Fimage%252F6f9dfc56-ef94-47f2-91ed-a6f16b91f58e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB72MJE/2025-11-25/image/6f9dfc56-ef94-47f2-91ed-a6f16b91f58e_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b54e961e-8138-5db1-80ff-a71013059b82
2025-12-01 19:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e967d90>
2025-12-01 19:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d59180b-d1ec-5c2b-9f81-876a812e1c8f/9d59180b-d1ec-5c2b-9f81-876a812e1c8f_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX69UED%252F2025-12-01%252Fimage%252Fb91b8faf-e762-4aca-9526-c67ca8fee65c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX69UED/2025-12-01/image/b91b8faf-e762-4aca-9526-c67ca8fee65c_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d59180b-d1ec-5c2b-9f81-876a812e1c8f
2025-12-01 19:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KO17WEX/2025-12-01/image/fd31edad-17a1-481b-a63f-aac851500c9b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117628272?view=catalogue)
2025-12-01 19:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX73WOH/2025-11-12/image/1cf49a13-1c13-45ef-b1ce-5a8a7c1a5708_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117080670?view=catalogue)
2025-12-01 19:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX69UED/2025-12-01/image/3a8ff86f-9f4f-4bf1-8030-986b6364bee6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117629580?view=catalogue)
2025-12-01 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKO17WEX%252F2025-12-01%252Fimage%252F4574be9c-18d7-43ae-be59-d6010e5e1beb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KO17WEX/2025-12-01/image/4574be9c-18d7-43ae-be59-d6010e5e1beb_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX69UED%252F2025-12-01%252Fimage%252F1949faf7-250a-4f3f-a743-ce03531ac39e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX69UED/2025-12-01/image/1949faf7-250a-4f3f-a743-ce03531ac39e_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117625254?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f50645a5150>
2025-12-01 19:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40fa02b3-6433-5a93-94dd-bccc5a18ed40/40fa02b3-6433-5a93-94dd-bccc5a18ed40_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX75XPS%252F2025-11-12%252Fimage%252F717c3857-ecc0-495c-9106-1f4981935b92_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX75XPS/2025-11-12/image/717c3857-ecc0-495c-9106-1f4981935b92_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 40fa02b3-6433-5a93-94dd-bccc5a18ed40
2025-12-01 19:02:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40fa02b3-6433-5a93-94dd-bccc5a18ed40, skipping ID generation
2025-12-01 19:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40fa02b3-6433-5a93-94dd-bccc5a18ed40 with scrape type 1
2025-12-01 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 40fa02b3-6433-5a93-94dd-bccc5a18ed40 from tracking dictionaries
2025-12-01 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40fa02b3-6433-5a93-94dd-bccc5a18ed40 sending to next pipeline
2025-12-01 19:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 40fa02b3-6433-5a93-94dd-bccc5a18ed40, identifier: 117086159
2025-12-01 19:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e5c6850>
2025-12-01 19:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96670254-9e60-53c1-a1c3-3ccb32ebbceb/96670254-9e60-53c1-a1c3-3ccb32ebbceb_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAU23OBX%252F2025-12-01%252Fimage%252Fbc5a24ec-9b6a-439f-b251-b18e313c797b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU23OBX/2025-12-01/image/bc5a24ec-9b6a-439f-b251-b18e313c797b_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 96670254-9e60-53c1-a1c3-3ccb32ebbceb
2025-12-01 19:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e61ce90>
2025-12-01 19:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2820895d-4683-5acb-9ccf-a641b030a16e/2820895d-4683-5acb-9ccf-a641b030a16e_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKO17WEX%252F2025-12-01%252Fimage%252Fadd26511-0a91-4c36-8992-c04e8c513469_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KO17WEX/2025-12-01/image/add26511-0a91-4c36-8992-c04e8c513469_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2820895d-4683-5acb-9ccf-a641b030a16e
2025-12-01 19:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM65NFL/2025-12-01/image/b29ba2d9-5cb9-46fd-9600-0f8005abb06d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117638370?view=catalogue)
2025-12-01 19:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AU23OBX/2025-12-01/image/0bbd359b-abd7-4cbc-96cf-54aea143b526_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634646?view=catalogue)
2025-12-01 19:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DA68HHG/2025-12-01/image/0fd9ca43-0a7d-4874-bbfe-542172157475_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117621025?view=catalogue)
2025-12-01 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAU23OBX%252F2025-12-01%252Fimage%252Fe5af90f2-e33e-4c3c-97ee-a6e10ff0e030_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU23OBX/2025-12-01/image/e5af90f2-e33e-4c3c-97ee-a6e10ff0e030_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDA68HHG%252F2025-12-01%252Fimage%252F83e19e44-00c2-4c64-8bd8-eaf6a2556ff8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA68HHG/2025-12-01/image/83e19e44-00c2-4c64-8bd8-eaf6a2556ff8_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM65NFL%252F2025-12-01%252Fimage%252F82bdc247-4e48-4f4f-b881-d2d364700ca5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM65NFL/2025-12-01/image/82bdc247-4e48-4f4f-b881-d2d364700ca5_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117623195?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117622987?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117631988?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 40fa02b3-6433-5a93-94dd-bccc5a18ed40 with identifier: 117086159
2025-12-01 19:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 40fa02b3-6433-5a93-94dd-bccc5a18ed40 with identifier: 117086159
2025-12-01 19:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 40fa02b3-6433-5a93-94dd-bccc5a18ed40 with identifier: 117086159 to the API
2025-12-01 19:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:02:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:02:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EX75XPS/2025-11-12/image/717c3857-ecc0-495c-9106-1f4981935b92_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '40fa02b3-6433-5a93-94dd-bccc5a18ed40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EX75XPS',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117086159',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FIAT',
 'model': '600 HATCHBACK',
 'odometer': 1845,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40fa02b3-6433-5a93-94dd-bccc5a18ed40/40fa02b3-6433-5a93-94dd-bccc5a18ed40_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34516,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/ab8329dd-8848-4112-9e88-af9c4f3875ae_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40fa02b3-6433-5a93-94dd-bccc5a18ed40/40fa02b3-6433-5a93-94dd-bccc5a18ed40_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38219,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/cef6c1e8-d17d-442b-85f5-48726819d6c8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40fa02b3-6433-5a93-94dd-bccc5a18ed40/40fa02b3-6433-5a93-94dd-bccc5a18ed40_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34081,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/24b95ed9-aa5b-4219-9107-14ebe5a6a862_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40fa02b3-6433-5a93-94dd-bccc5a18ed40/40fa02b3-6433-5a93-94dd-bccc5a18ed40_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37779,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/391d4949-1912-4335-80e5-e4b6c01e37ab_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40fa02b3-6433-5a93-94dd-bccc5a18ed40/40fa02b3-6433-5a93-94dd-bccc5a18ed40_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47434,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/9e78d511-a5d2-4fd7-9087-1653bd1704fb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40fa02b3-6433-5a93-94dd-bccc5a18ed40/40fa02b3-6433-5a93-94dd-bccc5a18ed40_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37906,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/ea09524a-2ee5-4844-b24c-c3eee26fa064_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40fa02b3-6433-5a93-94dd-bccc5a18ed40/40fa02b3-6433-5a93-94dd-bccc5a18ed40_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45867,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/cc16b2ce-e92a-4f75-b3eb-fcf6091b4188_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40fa02b3-6433-5a93-94dd-bccc5a18ed40/40fa02b3-6433-5a93-94dd-bccc5a18ed40_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37826,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX75XPS/2025-11-12/image/717c3857-ecc0-495c-9106-1f4981935b92_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-09-22',
 'seller_name': 'Motability Operations',
 'title': 'FIAT 600 HATCHBACK 1.2 Hybrid 48V 5dr eDCT-6',
 'transmission': 'automatic',
 'trim': '1.2 Hybrid 48V 5dr eDCT-6',
 'vin': None,
 'year': 2025}
2025-12-01 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117086159%27 HTTP/1.1" 200 None
2025-12-01 19:02:35 [astonbarclay.gb] INFO: Saving data for 117086159: {'created_time': 1764615755.109705, 'last_price_update_time': 1764615755.109716, 'auction_closing_time': 1765792800.0}
2025-12-01 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117086159') HTTP/1.1" 204 0
2025-12-01 19:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e60cd10>
2025-12-01 19:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2820895d-4683-5acb-9ccf-a641b030a16e/2820895d-4683-5acb-9ccf-a641b030a16e_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKO17WEX%252F2025-12-01%252Fimage%252F0203db56-8a30-46fc-9caf-2a95c26fe46e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KO17WEX/2025-12-01/image/0203db56-8a30-46fc-9caf-2a95c26fe46e_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2820895d-4683-5acb-9ccf-a641b030a16e
2025-12-01 19:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e7c3b90>
2025-12-01 19:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_9.jpg HTTP/1.1" 201 0
2025-12-01 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB72MJE%252F2025-11-25%252Fimage%252Fe7c57c5d-c232-4dbb-8965-083f63171029_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB72MJE/2025-11-25/image/e7c57c5d-c232-4dbb-8965-083f63171029_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b54e961e-8138-5db1-80ff-a71013059b82
2025-12-01 19:02:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b54e961e-8138-5db1-80ff-a71013059b82, skipping ID generation
2025-12-01 19:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b54e961e-8138-5db1-80ff-a71013059b82 with scrape type 1
2025-12-01 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b54e961e-8138-5db1-80ff-a71013059b82 from tracking dictionaries
2025-12-01 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b54e961e-8138-5db1-80ff-a71013059b82 sending to next pipeline
2025-12-01 19:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b54e961e-8138-5db1-80ff-a71013059b82, identifier: 117406754
2025-12-01 19:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e816a10>
2025-12-01 19:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d59180b-d1ec-5c2b-9f81-876a812e1c8f/9d59180b-d1ec-5c2b-9f81-876a812e1c8f_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX69UED%252F2025-12-01%252Fimage%252F976aeb19-50f5-4c27-8d21-ca7ec63a40ca_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX69UED/2025-12-01/image/976aeb19-50f5-4c27-8d21-ca7ec63a40ca_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9d59180b-d1ec-5c2b-9f81-876a812e1c8f
2025-12-01 19:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KO17WEX/2025-12-01/image/096d985d-f0b7-4926-ac48-c194a9376cf6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117628272?view=catalogue)
2025-12-01 19:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX69UED/2025-12-01/image/a3896bca-0380-40a4-8bce-fe581f28d386_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117629580?view=catalogue)
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKO17WEX%252F2025-12-01%252Fimage%252Fd87afa89-f04f-427a-b49c-2c003ea09013_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KO17WEX/2025-12-01/image/d87afa89-f04f-427a-b49c-2c003ea09013_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX69UED%252F2025-12-01%252Fimage%252F22848df7-7559-41c6-af64-ae33558efb1d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX69UED/2025-12-01/image/22848df7-7559-41c6-af64-ae33558efb1d_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117632412?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b54e961e-8138-5db1-80ff-a71013059b82 with identifier: 117406754
2025-12-01 19:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b54e961e-8138-5db1-80ff-a71013059b82 with identifier: 117406754
2025-12-01 19:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 10, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'volkswagen id.4 estate 109kw life pure 52kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'id.4 estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 12018, 'odometer_reading_unit': 'mi', 'registration_date': '2022-12-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117406754', 'expiration_date': '2025-12-15t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '109kw life pure 52kwh 5dr auto', 'license_plate': 'lb72mje', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'b54e961e-8138-5db1-80ff-a71013059b82', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/f846d76e-d8e7-425a-b3ef-84a6036cdb7d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29843}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/1c0d997f-0a2c-4dcd-9016-5742382d2f69_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29707}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/6f6e13d7-44d5-4208-94dd-38804e2ff26f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29164}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/7fee3152-b978-4104-b97f-67f4b7693970_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31021}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/66d8b059-aed6-4d1a-b93c-e1fa78602e94_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 41011}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/428dff45-5436-4f84-b534-e595767e5952_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 38020}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/b3d66280-1e04-46b5-af63-c070920af967_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 46698}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/b3e68666-76b5-4329-be30-68e52f2e2c69_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 48369}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/6f9dfc56-ef94-47f2-91ed-a6f16b91f58e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 44672}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/e7c57c5d-c232-4dbb-8965-083f63171029_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 44435}], 'current_year_diff': 3, 'age_in_months': 35, 'make_model': 'volkswagen id.4 estate', 'sanitized_make': 'volkswagen', 'odometer_in_km': 19341} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 35,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-15t10:00:00z',
     'fuel_type': 'electric',
     'id': 'b54e961e-8138-5db1-80ff-a71013059b82',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'lb72mje',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117406754',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'volkswagen',
     'make_model': 'volkswagen id.4 estate',
     'model': 'id.4 estate',
     'odometer': 12018,
     'odometer_in_km': 19341,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 10,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29843,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/f846d76e-d8e7-425a-b3ef-84a6036cdb7d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29707,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/1c0d997f-0a2c-4dcd-9016-5742382d2f69_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29164,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/6f6e13d7-44d5-4208-94dd-38804e2ff26f_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31021,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/7fee3152-b978-4104-b97f-67f4b7693970_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41011,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/66d8b059-aed6-4d1a-b93c-e1fa78602e94_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 38020,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/428dff45-5436-4f84-b534-e595767e5952_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46698,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/b3d66280-1e04-46b5-af63-c070920af967_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48369,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/b3e68666-76b5-4329-be30-68e52f2e2c69_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 44672,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/6f9dfc56-ef94-47f2-91ed-a6f16b91f58e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 44435,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/e7c57c5d-c232-4dbb-8965-083f63171029_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-12-30',
     'sanitized_make': 'volkswagen',
     'seller_name': 'motability operations',
     'title': 'volkswagen id.4 estate 109kw life pure 52kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '109kw life pure 52kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-12-01 19:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: b54e961e-8138-5db1-80ff-a71013059b82 spider: astonbarclay.gb
2025-12-01 19:02:36 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: b54e961e-8138-5db1-80ff-a71013059b82 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 10, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'volkswagen id.4 estate 109kw life pure 52kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'id.4 estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 12018, 'odometer_reading_unit': 'mi', 'registration_date': '2022-12-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117406754', 'expiration_date': '2025-12-15t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '109kw life pure 52kwh 5dr auto', 'license_plate': 'lb72mje', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'b54e961e-8138-5db1-80ff-a71013059b82', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/f846d76e-d8e7-425a-b3ef-84a6036cdb7d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29843}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/1c0d997f-0a2c-4dcd-9016-5742382d2f69_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29707}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/6f6e13d7-44d5-4208-94dd-38804e2ff26f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29164}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/7fee3152-b978-4104-b97f-67f4b7693970_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31021}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/66d8b059-aed6-4d1a-b93c-e1fa78602e94_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 41011}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/428dff45-5436-4f84-b534-e595767e5952_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 38020}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/b3d66280-1e04-46b5-af63-c070920af967_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 46698}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/b3e68666-76b5-4329-be30-68e52f2e2c69_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 48369}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/6f9dfc56-ef94-47f2-91ed-a6f16b91f58e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 44672}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/e7c57c5d-c232-4dbb-8965-083f63171029_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 44435}], 'current_year_diff': 3, 'age_in_months': 35, 'make_model': 'volkswagen id.4 estate', 'sanitized_make': 'volkswagen', 'odometer_in_km': 19341} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 35,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-15t10:00:00z',
     'fuel_type': 'electric',
     'id': 'b54e961e-8138-5db1-80ff-a71013059b82',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'lb72mje',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117406754',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'volkswagen',
     'make_model': 'volkswagen id.4 estate',
     'model': 'id.4 estate',
     'odometer': 12018,
     'odometer_in_km': 19341,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 10,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29843,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/f846d76e-d8e7-425a-b3ef-84a6036cdb7d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29707,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/1c0d997f-0a2c-4dcd-9016-5742382d2f69_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29164,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/6f6e13d7-44d5-4208-94dd-38804e2ff26f_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31021,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/7fee3152-b978-4104-b97f-67f4b7693970_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 41011,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/66d8b059-aed6-4d1a-b93c-e1fa78602e94_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 38020,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/428dff45-5436-4f84-b534-e595767e5952_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46698,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/b3d66280-1e04-46b5-af63-c070920af967_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48369,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/b3e68666-76b5-4329-be30-68e52f2e2c69_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 44672,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/6f9dfc56-ef94-47f2-91ed-a6f16b91f58e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 44435,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/e7c57c5d-c232-4dbb-8965-083f63171029_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-12-30',
     'sanitized_make': 'volkswagen',
     'seller_name': 'motability operations',
     'title': 'volkswagen id.4 estate 109kw life pure 52kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '109kw life pure 52kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'b54e961e-8138-5db1-80ff-a71013059b82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LB72MJE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117406754',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'ID.4 ESTATE',
 'odometer': 12018,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29843,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/f846d76e-d8e7-425a-b3ef-84a6036cdb7d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29707,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/1c0d997f-0a2c-4dcd-9016-5742382d2f69_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29164,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/6f6e13d7-44d5-4208-94dd-38804e2ff26f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31021,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/7fee3152-b978-4104-b97f-67f4b7693970_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41011,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/66d8b059-aed6-4d1a-b93c-e1fa78602e94_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38020,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/428dff45-5436-4f84-b534-e595767e5952_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46698,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/b3d66280-1e04-46b5-af63-c070920af967_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48369,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/b3e68666-76b5-4329-be30-68e52f2e2c69_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44672,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/6f9dfc56-ef94-47f2-91ed-a6f16b91f58e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54e961e-8138-5db1-80ff-a71013059b82/b54e961e-8138-5db1-80ff-a71013059b82_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44435,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB72MJE/2025-11-25/image/e7c57c5d-c232-4dbb-8965-083f63171029_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-30',
 'seller_name': 'Motability Operations',
 'title': 'VOLKSWAGEN ID.4 ESTATE 109kW Life Pure 52kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '109kW Life Pure 52kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117406754%27 HTTP/1.1" 200 None
2025-12-01 19:02:36 [astonbarclay.gb] INFO: Saving data for 117406754: {'created_time': 1764615756.267644, 'last_price_update_time': 1764615756.267654, 'auction_closing_time': 1765792800.0}
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117406754') HTTP/1.1" 204 0
2025-12-01 19:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e8146d0>
2025-12-01 19:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b3e037-7659-53a6-8aac-f95cdcbf00a1/a8b3e037-7659-53a6-8aac-f95cdcbf00a1_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDA68HHG%252F2025-12-01%252Fimage%252Fe20953c5-178e-4304-89c3-a85f9a2f5205_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA68HHG/2025-12-01/image/e20953c5-178e-4304-89c3-a85f9a2f5205_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a8b3e037-7659-53a6-8aac-f95cdcbf00a1
2025-12-01 19:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e859850>
2025-12-01 19:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96670254-9e60-53c1-a1c3-3ccb32ebbceb/96670254-9e60-53c1-a1c3-3ccb32ebbceb_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAU23OBX%252F2025-12-01%252Fimage%252F9816596c-c6d7-43d2-a414-884363cca987_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU23OBX/2025-12-01/image/9816596c-c6d7-43d2-a414-884363cca987_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 96670254-9e60-53c1-a1c3-3ccb32ebbceb
2025-12-01 19:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DA68HHG/2025-12-01/image/8f3f792e-ab1a-4b82-bd86-c639772865ab_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117621025?view=catalogue)
2025-12-01 19:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM65NFL/2025-12-01/image/e0a74c21-41e5-4ee6-9d3a-c19a287d16bd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117638370?view=catalogue)
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAU23OBX%252F2025-12-01%252Fimage%252Fa7e4ea61-c38b-46fc-a4e4-e94d5232e13b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU23OBX/2025-12-01/image/a7e4ea61-c38b-46fc-a4e4-e94d5232e13b_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDA68HHG%252F2025-12-01%252Fimage%252F15487dc9-69a1-476d-a8c4-376f906c5ab1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA68HHG/2025-12-01/image/15487dc9-69a1-476d-a8c4-376f906c5ab1_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM65NFL%252F2025-12-01%252Fimage%252F90174c2c-176e-4233-9083-b49fc86221ae_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM65NFL/2025-12-01/image/90174c2c-176e-4233-9083-b49fc86221ae_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e680b10>
2025-12-01 19:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2820895d-4683-5acb-9ccf-a641b030a16e/2820895d-4683-5acb-9ccf-a641b030a16e_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKO17WEX%252F2025-12-01%252Fimage%252Ffd31edad-17a1-481b-a63f-aac851500c9b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KO17WEX/2025-12-01/image/fd31edad-17a1-481b-a63f-aac851500c9b_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2820895d-4683-5acb-9ccf-a641b030a16e
2025-12-01 19:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e7102d0>
2025-12-01 19:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1a8361b-a960-5c0c-86a5-26eec748d1ec/a1a8361b-a960-5c0c-86a5-26eec748d1ec_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX73WOH%252F2025-11-12%252Fimage%252F1cf49a13-1c13-45ef-b1ce-5a8a7c1a5708_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX73WOH/2025-11-12/image/1cf49a13-1c13-45ef-b1ce-5a8a7c1a5708_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a1a8361b-a960-5c0c-86a5-26eec748d1ec
2025-12-01 19:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e71d750>
2025-12-01 19:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-01 19:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d59180b-d1ec-5c2b-9f81-876a812e1c8f/9d59180b-d1ec-5c2b-9f81-876a812e1c8f_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX69UED%252F2025-12-01%252Fimage%252F3a8ff86f-9f4f-4bf1-8030-986b6364bee6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX69UED/2025-12-01/image/3a8ff86f-9f4f-4bf1-8030-986b6364bee6_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9d59180b-d1ec-5c2b-9f81-876a812e1c8f
2025-12-01 19:02:37 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117625254, 'registration': 'PK18ANU', 'account': 'WBA001', 'make': 'BMW', 'model': 'X5 DIESEL ESTATE', 'derivative': 'xDrive40d M Sport 5dr Auto [7 Seat]', 'mileage': 85981, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2018-03-28', 'fuel': 'Diesel', 'motExpiry': '2026-02-24', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/PK18ANU/2025-12-01/image/fa6140ba-06bf-4290-88f2-9a067c8148d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/cbb8b071-c90f-45ef-9f05-5df7678a4fdc_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/ced25ed9-c49f-4bdd-8164-b56a0881dae7_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/f23f2cf3-9eec-4329-85c7-7093c5c1720c_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/c5e5975c-eca4-472a-89d8-c60114f01127_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/84b0205b-d81e-4fda-96e2-5ed8e4999d56_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/cb2957d0-de69-476f-978a-4bb05a04478c_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/8db11a3b-e74d-4b44-8448-e50fdea3d811_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/fd8bd7f3-e8a5-4517-9f61-7516fc265415_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/12fe1d66-65e9-4e58-a7f9-1575c7715089_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/f7c371da-7154-457a-89df-bc46f97ade8a_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/4f7deb18-1649-472f-9cf3-3497394c3c9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/a75f8eaf-dabb-4ce5-908b-ed613f766818_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/781c893c-f9ad-4553-981e-0dcae7733f70_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 09/21- 33K', 'remarks': 'VOSA STATES 46K, 48K, 49K, 49K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 183, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ec65fb06-c7c0-48f9-bcd4-e9f95f165050.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:37 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117625254, 'registration': 'PK18ANU', 'account': 'WBA001', 'make': 'BMW', 'model': 'X5 DIESEL ESTATE', 'derivative': 'xDrive40d M Sport 5dr Auto [7 Seat]', 'mileage': 85981, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2018-03-28', 'fuel': 'Diesel', 'motExpiry': '2026-02-24', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/PK18ANU/2025-12-01/image/fa6140ba-06bf-4290-88f2-9a067c8148d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/cbb8b071-c90f-45ef-9f05-5df7678a4fdc_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/ced25ed9-c49f-4bdd-8164-b56a0881dae7_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/f23f2cf3-9eec-4329-85c7-7093c5c1720c_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/c5e5975c-eca4-472a-89d8-c60114f01127_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/84b0205b-d81e-4fda-96e2-5ed8e4999d56_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/cb2957d0-de69-476f-978a-4bb05a04478c_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/8db11a3b-e74d-4b44-8448-e50fdea3d811_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/fd8bd7f3-e8a5-4517-9f61-7516fc265415_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/12fe1d66-65e9-4e58-a7f9-1575c7715089_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/f7c371da-7154-457a-89df-bc46f97ade8a_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/4f7deb18-1649-472f-9cf3-3497394c3c9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/a75f8eaf-dabb-4ce5-908b-ed613f766818_removebg.jpg?w=600', 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/781c893c-f9ad-4553-981e-0dcae7733f70_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 09/21- 33K', 'remarks': 'VOSA STATES 46K, 48K, 49K, 49K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 183, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ec65fb06-c7c0-48f9-bcd4-e9f95f165050.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f9a2d1f-5d0f-5846-b610-9c0e398774d5 with identifier: 117625254
2025-12-01 19:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f9a2d1f-5d0f-5846-b610-9c0e398774d5 with scrape type 1
2025-12-01 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 3f9a2d1f-5d0f-5846-b610-9c0e398774d5
2025-12-01 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPK18ANU%252F2025-12-01%252Fimage%252Ffa6140ba-06bf-4290-88f2-9a067c8148d8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK18ANU/2025-12-01/image/fa6140ba-06bf-4290-88f2-9a067c8148d8_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AU23OBX/2025-12-01/image/c020cfae-1ff5-4027-8cfc-e8fdc367e285_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634646?view=catalogue)
2025-12-01 19:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KO17WEX/2025-12-01/image/049646db-5224-4a39-bdf0-4aee6d7ca1f5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117628272?view=catalogue)
2025-12-01 19:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX69UED/2025-12-01/image/1094ac23-c88f-4b33-81a0-245b373faf84_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117629580?view=catalogue)
2025-12-01 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKO17WEX%252F2025-12-01%252Fimage%252Fd42d7de0-9cb4-4c4e-a5a5-91cc07f29fe6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KO17WEX/2025-12-01/image/d42d7de0-9cb4-4c4e-a5a5-91cc07f29fe6_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX69UED%252F2025-12-01%252Fimage%252F3060d354-32c1-43e1-a34f-327d14864a9f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX69UED/2025-12-01/image/3060d354-32c1-43e1-a34f-327d14864a9f_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e4250d0>
2025-12-01 19:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8860decc-d092-5183-b3ca-b40ba3560e46/8860decc-d092-5183-b3ca-b40ba3560e46_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM65NFL%252F2025-12-01%252Fimage%252Fb29ba2d9-5cb9-46fd-9600-0f8005abb06d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM65NFL/2025-12-01/image/b29ba2d9-5cb9-46fd-9600-0f8005abb06d_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8860decc-d092-5183-b3ca-b40ba3560e46
2025-12-01 19:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e98fad0>
2025-12-01 19:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96670254-9e60-53c1-a1c3-3ccb32ebbceb/96670254-9e60-53c1-a1c3-3ccb32ebbceb_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAU23OBX%252F2025-12-01%252Fimage%252F0bbd359b-abd7-4cbc-96cf-54aea143b526_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU23OBX/2025-12-01/image/0bbd359b-abd7-4cbc-96cf-54aea143b526_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 96670254-9e60-53c1-a1c3-3ccb32ebbceb
2025-12-01 19:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e86ba10>
2025-12-01 19:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b3e037-7659-53a6-8aac-f95cdcbf00a1/a8b3e037-7659-53a6-8aac-f95cdcbf00a1_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDA68HHG%252F2025-12-01%252Fimage%252F0fd9ca43-0a7d-4874-bbfe-542172157475_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA68HHG/2025-12-01/image/0fd9ca43-0a7d-4874-bbfe-542172157475_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a8b3e037-7659-53a6-8aac-f95cdcbf00a1
2025-12-01 19:02:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117623195, 'registration': 'CT19GDV', 'account': 'WBA001', 'make': 'SEAT', 'model': 'MII HATCHBACK', 'derivative': '1.0 Design Mii [EZ] 5dr', 'mileage': 37447, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2019-04-30', 'fuel': 'Petrol', 'motExpiry': '2026-04-29', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CT19GDV/2025-12-01/image/d8543f5d-d344-4306-b3cc-b982621bf191_removebg.jpg?w=600', 'https://abimg003.imgix.net/CT19GDV/2025-12-01/image/f5ca84ab-0d04-44a5-81e3-af851f931e89_removebg.jpg?w=600', 'https://abimg003.imgix.net/CT19GDV/2025-12-01/image/182b8f7b-9db3-4c36-ad59-07f3851f07ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/CT19GDV/2025-12-01/image/0b214c68-7983-4e33-883a-a1685fd57f15_removebg.jpg?w=600', 'https://abimg003.imgix.net/CT19GDV/2025-12-01/image/b08bdcc8-f2c8-4bf8-a9b7-3d0a115079fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/CT19GDV/2025-12-01/image/53a278b7-eb92-42b1-9130-537dc5be2863_removebg.jpg?w=600', 'https://abimg003.imgix.net/CT19GDV/2025-12-01/image/edb0841f-cd24-4e3c-aacb-2b6113cc462d_removebg.jpg?w=600', 'https://abimg003.imgix.net/CT19GDV/2025-12-01/image/619608df-95c0-4ecf-b1d2-f83012bf3816_removebg.jpg?w=600', 'https://abimg003.imgix.net/CT19GDV/2025-12-01/image/f4980e63-bb7e-4ab4-92a5-d151785a28f7_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/20- 2K, 09/21- 2K, 11/24- 28K', 'remarks': 'VOSA STATES 3K, 7K, 19K, 31K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 96, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117623195, 'registration': 'CT19GDV', 'account': 'WBA001', 'make': 'SEAT', 'model': 'MII HATCHBACK', 'derivative': '1.0 Design Mii [EZ] 5dr', 'mileage': 37447, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2019-04-30', 'fuel': 'Petrol', 'motExpiry': '2026-04-29', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CT19GDV/2025-12-01/image/d8543f5d-d344-4306-b3cc-b982621bf191_removebg.jpg?w=600', 'https://abimg003.imgix.net/CT19GDV/2025-12-01/image/f5ca84ab-0d04-44a5-81e3-af851f931e89_removebg.jpg?w=600', 'https://abimg003.imgix.net/CT19GDV/2025-12-01/image/182b8f7b-9db3-4c36-ad59-07f3851f07ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/CT19GDV/2025-12-01/image/0b214c68-7983-4e33-883a-a1685fd57f15_removebg.jpg?w=600', 'https://abimg003.imgix.net/CT19GDV/2025-12-01/image/b08bdcc8-f2c8-4bf8-a9b7-3d0a115079fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/CT19GDV/2025-12-01/image/53a278b7-eb92-42b1-9130-537dc5be2863_removebg.jpg?w=600', 'https://abimg003.imgix.net/CT19GDV/2025-12-01/image/edb0841f-cd24-4e3c-aacb-2b6113cc462d_removebg.jpg?w=600', 'https://abimg003.imgix.net/CT19GDV/2025-12-01/image/619608df-95c0-4ecf-b1d2-f83012bf3816_removebg.jpg?w=600', 'https://abimg003.imgix.net/CT19GDV/2025-12-01/image/f4980e63-bb7e-4ab4-92a5-d151785a28f7_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/20- 2K, 09/21- 2K, 11/24- 28K', 'remarks': 'VOSA STATES 3K, 7K, 19K, 31K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 96, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59764ae9-5e5a-5748-b4ed-bf9aea82270a with identifier: 117623195
2025-12-01 19:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59764ae9-5e5a-5748-b4ed-bf9aea82270a with scrape type 1
2025-12-01 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 59764ae9-5e5a-5748-b4ed-bf9aea82270a
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCT19GDV%252F2025-12-01%252Fimage%252Fd8543f5d-d344-4306-b3cc-b982621bf191_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CT19GDV/2025-12-01/image/d8543f5d-d344-4306-b3cc-b982621bf191_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117622987, 'registration': 'SD20HGY', 'account': 'WBA001', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '30 TFSI Black Edition 5dr', 'mileage': 39555, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2020-08-06', 'fuel': 'Petrol', 'motExpiry': '2026-11-11', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SD20HGY/2025-12-01/image/4362a4ee-f363-4bc1-b26b-f1e313668e52_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD20HGY/2025-12-01/image/b92be8cd-5cc5-4eb3-a8a9-f14ca1587f2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD20HGY/2025-12-01/image/2bd50cf9-cd59-4b53-9074-21b1e65b944d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD20HGY/2025-12-01/image/6b8a0c4d-ce04-4e3d-934a-975232d3a771_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD20HGY/2025-12-01/image/e153a2c1-dfb2-4b01-815d-f20798392446_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD20HGY/2025-12-01/image/d8ad4aa4-41a9-4151-9148-8e85e2a81ca4_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD20HGY/2025-12-01/image/97c3c506-318a-47a0-9dea-ef3ecf231b9b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD20HGY/2025-12-01/image/1fe48c30-f3fb-44bd-ae34-d894d8e15a2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD20HGY/2025-12-01/image/af4932b7-fbfc-4ebf-b795-3509880f628d_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/21- 7K, 01/23- 16K, 02/24- 25K, 04/25- 35K', 'remarks': 'VOSA STATES 21K, 31K, 39K, SPARE KEY IN OFFICE, SD CARD IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/191b4729-5d50-4103-8681-f5c536150e8d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117622987, 'registration': 'SD20HGY', 'account': 'WBA001', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '30 TFSI Black Edition 5dr', 'mileage': 39555, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2020-08-06', 'fuel': 'Petrol', 'motExpiry': '2026-11-11', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SD20HGY/2025-12-01/image/4362a4ee-f363-4bc1-b26b-f1e313668e52_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD20HGY/2025-12-01/image/b92be8cd-5cc5-4eb3-a8a9-f14ca1587f2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD20HGY/2025-12-01/image/2bd50cf9-cd59-4b53-9074-21b1e65b944d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD20HGY/2025-12-01/image/6b8a0c4d-ce04-4e3d-934a-975232d3a771_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD20HGY/2025-12-01/image/e153a2c1-dfb2-4b01-815d-f20798392446_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD20HGY/2025-12-01/image/d8ad4aa4-41a9-4151-9148-8e85e2a81ca4_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD20HGY/2025-12-01/image/97c3c506-318a-47a0-9dea-ef3ecf231b9b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD20HGY/2025-12-01/image/1fe48c30-f3fb-44bd-ae34-d894d8e15a2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD20HGY/2025-12-01/image/af4932b7-fbfc-4ebf-b795-3509880f628d_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/21- 7K, 01/23- 16K, 02/24- 25K, 04/25- 35K', 'remarks': 'VOSA STATES 21K, 31K, 39K, SPARE KEY IN OFFICE, SD CARD IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/191b4729-5d50-4103-8681-f5c536150e8d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba with identifier: 117622987
2025-12-01 19:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba with scrape type 1
2025-12-01 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD20HGY%252F2025-12-01%252Fimage%252F4362a4ee-f363-4bc1-b26b-f1e313668e52_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD20HGY/2025-12-01/image/4362a4ee-f363-4bc1-b26b-f1e313668e52_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117631988, 'registration': 'BP69WJJ', 'account': 'WBA001', 'make': 'VOLKSWAGEN', 'model': 'POLO HATCHBACK', 'derivative': '1.0 TSI 115 R-Line 5dr DSG', 'mileage': 77109, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2020-01-24', 'fuel': 'Petrol', 'motExpiry': '2026-01-28', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 03/21- 12K', 'remarks': 'VOSA STATES 29K, 46K, 65K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117631988, 'registration': 'BP69WJJ', 'account': 'WBA001', 'make': 'VOLKSWAGEN', 'model': 'POLO HATCHBACK', 'derivative': '1.0 TSI 115 R-Line 5dr DSG', 'mileage': 77109, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2020-01-24', 'fuel': 'Petrol', 'motExpiry': '2026-01-28', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 03/21- 12K', 'remarks': 'VOSA STATES 29K, 46K, 65K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 111, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ff66e97-4c42-506d-ab45-5c4f1e638904 with identifier: 117631988
2025-12-01 19:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ff66e97-4c42-506d-ab45-5c4f1e638904 with scrape type 1
2025-12-01 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 7ff66e97-4c42-506d-ab45-5c4f1e638904
2025-12-01 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 7ff66e97-4c42-506d-ab45-5c4f1e638904
2025-12-01 19:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7ff66e97-4c42-506d-ab45-5c4f1e638904, identifier: 117631988
2025-12-01 19:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DA68HHG/2025-12-01/image/30a8f0d6-17d2-410d-8556-ffe1b5e48fd6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117621025?view=catalogue)
2025-12-01 19:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AU23OBX/2025-12-01/image/19f364bb-be75-4107-877a-6da8ff652d72_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634646?view=catalogue)
2025-12-01 19:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM65NFL/2025-12-01/image/99baec5d-3d0f-4887-b275-75305120f659_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117638370?view=catalogue)
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDA68HHG%252F2025-12-01%252Fimage%252Fae4922ab-7021-4197-a061-721d2ae60777_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA68HHG/2025-12-01/image/ae4922ab-7021-4197-a061-721d2ae60777_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM65NFL%252F2025-12-01%252Fimage%252F49e2ba5e-3361-4707-91a2-fd86aba16894_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM65NFL/2025-12-01/image/49e2ba5e-3361-4707-91a2-fd86aba16894_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPK18ANU%252F2025-12-01%252Fimage%252Fcbb8b071-c90f-45ef-9f05-5df7678a4fdc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK18ANU/2025-12-01/image/cbb8b071-c90f-45ef-9f05-5df7678a4fdc_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7ff66e97-4c42-506d-ab45-5c4f1e638904 with identifier: 117631988
2025-12-01 19:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7ff66e97-4c42-506d-ab45-5c4f1e638904 with identifier: 117631988
2025-12-01 19:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7ff66e97-4c42-506d-ab45-5c4f1e638904 with identifier: 117631988 to the API
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%277ff66e97-4c42-506d-ab45-5c4f1e638904%27 HTTP/1.1" 200 None
2025-12-01 19:02:39 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 7ff66e97-4c42-506d-ab45-5c4f1e638904: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:02:37 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117631988?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '7ff66e97-4c42-506d-ab45-5c4f1e638904',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BP69WJJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117631988',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'POLO HATCHBACK',
 'odometer': 77109,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-24',
 'seller_name': 'UKCGR',
 'title': 'VOLKSWAGEN POLO HATCHBACK 1.0 TSI 115 R-Line 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.0 TSI 115 R-Line 5dr DSG',
 'vin': None,
 'year': 2020}
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117631988%27 HTTP/1.1" 200 None
2025-12-01 19:02:39 [astonbarclay.gb] INFO: Saving data for 117631988: {'created_time': 1764615759.021108, 'last_price_update_time': 1764615759.021119}
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117631988') HTTP/1.1" 204 0
2025-12-01 19:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e40fd90>
2025-12-01 19:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2820895d-4683-5acb-9ccf-a641b030a16e/2820895d-4683-5acb-9ccf-a641b030a16e_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKO17WEX%252F2025-12-01%252Fimage%252F096d985d-f0b7-4926-ac48-c194a9376cf6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KO17WEX/2025-12-01/image/096d985d-f0b7-4926-ac48-c194a9376cf6_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2820895d-4683-5acb-9ccf-a641b030a16e
2025-12-01 19:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6c2b10>
2025-12-01 19:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d59180b-d1ec-5c2b-9f81-876a812e1c8f/9d59180b-d1ec-5c2b-9f81-876a812e1c8f_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX69UED%252F2025-12-01%252Fimage%252Fa3896bca-0380-40a4-8bce-fe581f28d386_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX69UED/2025-12-01/image/a3896bca-0380-40a4-8bce-fe581f28d386_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9d59180b-d1ec-5c2b-9f81-876a812e1c8f
2025-12-01 19:02:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117632412, 'registration': 'FE16VCD', 'account': 'WBA001', 'make': 'VOLKSWAGEN', 'model': 'GOLF', 'derivative': None, 'mileage': 54988, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': None, 'firstRegistration': '2016-03-24', 'fuel': 'Petrol', 'motExpiry': '2026-03-30', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service book 11/17-15k,  10/18-25k,', 'remarks': 'SPARE KEY - SD CARD - VOSA STATES 53k 49k 47k 44k', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': None, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117632412, 'registration': 'FE16VCD', 'account': 'WBA001', 'make': 'VOLKSWAGEN', 'model': 'GOLF', 'derivative': None, 'mileage': 54988, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': None, 'firstRegistration': '2016-03-24', 'fuel': 'Petrol', 'motExpiry': '2026-03-30', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service book 11/17-15k,  10/18-25k,', 'remarks': 'SPARE KEY - SD CARD - VOSA STATES 53k 49k 47k 44k', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': None, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:39 [astonbarclay.gb] ERROR: Error parsing details: Field transmission is not nullable
2025-12-01 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KO17WEX/2025-12-01/image/4574be9c-18d7-43ae-be59-d6010e5e1beb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117628272?view=catalogue)
2025-12-01 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX69UED/2025-12-01/image/1949faf7-250a-4f3f-a743-ce03531ac39e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117629580?view=catalogue)
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX69UED%252F2025-12-01%252Fimage%252Fa82b318a-d426-4d88-bf0e-d0cea6434722_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX69UED/2025-12-01/image/a82b318a-d426-4d88-bf0e-d0cea6434722_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCT19GDV%252F2025-12-01%252Fimage%252Ff5ca84ab-0d04-44a5-81e3-af851f931e89_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CT19GDV/2025-12-01/image/f5ca84ab-0d04-44a5-81e3-af851f931e89_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD20HGY%252F2025-12-01%252Fimage%252Fb92be8cd-5cc5-4eb3-a8a9-f14ca1587f2d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD20HGY/2025-12-01/image/b92be8cd-5cc5-4eb3-a8a9-f14ca1587f2d_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5064411e90>
2025-12-01 19:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b3e037-7659-53a6-8aac-f95cdcbf00a1/a8b3e037-7659-53a6-8aac-f95cdcbf00a1_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDA68HHG%252F2025-12-01%252Fimage%252F8f3f792e-ab1a-4b82-bd86-c639772865ab_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA68HHG/2025-12-01/image/8f3f792e-ab1a-4b82-bd86-c639772865ab_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a8b3e037-7659-53a6-8aac-f95cdcbf00a1
2025-12-01 19:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e88cc10>
2025-12-01 19:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8860decc-d092-5183-b3ca-b40ba3560e46/8860decc-d092-5183-b3ca-b40ba3560e46_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM65NFL%252F2025-12-01%252Fimage%252Fe0a74c21-41e5-4ee6-9d3a-c19a287d16bd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM65NFL/2025-12-01/image/e0a74c21-41e5-4ee6-9d3a-c19a287d16bd_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8860decc-d092-5183-b3ca-b40ba3560e46
2025-12-01 19:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AP23VKB/2025-11-25/image/5a35829f-1fac-48a5-9644-d6b708c9dacf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117185008?view=catalogue)
2025-12-01 19:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX73WOH/2025-11-12/image/6be52a8c-6c4e-4b01-baf7-ffe57b26864f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117080670?view=catalogue)
2025-12-01 19:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LY74DXW/2025-11-10/image/ec2f2cf0-02c5-4798-90dc-ab567ad265db_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117023136?view=catalogue)
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDA68HHG%252F2025-12-01%252Fimage%252F6ad03bcc-9401-477d-b335-b28bff4193a4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA68HHG/2025-12-01/image/6ad03bcc-9401-477d-b335-b28bff4193a4_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM65NFL%252F2025-12-01%252Fimage%252Fcb1377ee-50e8-4c26-b3df-c625d437a5c7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM65NFL/2025-12-01/image/cb1377ee-50e8-4c26-b3df-c625d437a5c7_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPK18ANU%252F2025-12-01%252Fimage%252Fced25ed9-c49f-4bdd-8164-b56a0881dae7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK18ANU/2025-12-01/image/ced25ed9-c49f-4bdd-8164-b56a0881dae7_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e844890>
2025-12-01 19:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96670254-9e60-53c1-a1c3-3ccb32ebbceb/96670254-9e60-53c1-a1c3-3ccb32ebbceb_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAU23OBX%252F2025-12-01%252Fimage%252Fc020cfae-1ff5-4027-8cfc-e8fdc367e285_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU23OBX/2025-12-01/image/c020cfae-1ff5-4027-8cfc-e8fdc367e285_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 96670254-9e60-53c1-a1c3-3ccb32ebbceb
2025-12-01 19:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f70a2d0>
2025-12-01 19:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2820895d-4683-5acb-9ccf-a641b030a16e/2820895d-4683-5acb-9ccf-a641b030a16e_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKO17WEX%252F2025-12-01%252Fimage%252F049646db-5224-4a39-bdf0-4aee6d7ca1f5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KO17WEX/2025-12-01/image/049646db-5224-4a39-bdf0-4aee6d7ca1f5_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2820895d-4683-5acb-9ccf-a641b030a16e
2025-12-01 19:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e627610>
2025-12-01 19:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d59180b-d1ec-5c2b-9f81-876a812e1c8f/9d59180b-d1ec-5c2b-9f81-876a812e1c8f_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX69UED%252F2025-12-01%252Fimage%252F1094ac23-c88f-4b33-81a0-245b373faf84_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX69UED/2025-12-01/image/1094ac23-c88f-4b33-81a0-245b373faf84_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9d59180b-d1ec-5c2b-9f81-876a812e1c8f
2025-12-01 19:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DA68HHG/2025-12-01/image/83e19e44-00c2-4c64-8bd8-eaf6a2556ff8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117621025?view=catalogue)
2025-12-01 19:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AU23OBX/2025-12-01/image/e5af90f2-e33e-4c3c-97ee-a6e10ff0e030_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634646?view=catalogue)
2025-12-01 19:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM65NFL/2025-12-01/image/82bdc247-4e48-4f4f-b881-d2d364700ca5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117638370?view=catalogue)
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX69UED%252F2025-12-01%252Fimage%252F4f05a703-eb66-4353-8185-cbd14f32f981_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX69UED/2025-12-01/image/4f05a703-eb66-4353-8185-cbd14f32f981_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCT19GDV%252F2025-12-01%252Fimage%252F182b8f7b-9db3-4c36-ad59-07f3851f07ef_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CT19GDV/2025-12-01/image/182b8f7b-9db3-4c36-ad59-07f3851f07ef_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD20HGY%252F2025-12-01%252Fimage%252F2bd50cf9-cd59-4b53-9074-21b1e65b944d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD20HGY/2025-12-01/image/2bd50cf9-cd59-4b53-9074-21b1e65b944d_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117625569?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e976b90>
2025-12-01 19:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b3e037-7659-53a6-8aac-f95cdcbf00a1/a8b3e037-7659-53a6-8aac-f95cdcbf00a1_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDA68HHG%252F2025-12-01%252Fimage%252F30a8f0d6-17d2-410d-8556-ffe1b5e48fd6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA68HHG/2025-12-01/image/30a8f0d6-17d2-410d-8556-ffe1b5e48fd6_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a8b3e037-7659-53a6-8aac-f95cdcbf00a1
2025-12-01 19:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e54fa90>
2025-12-01 19:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96670254-9e60-53c1-a1c3-3ccb32ebbceb/96670254-9e60-53c1-a1c3-3ccb32ebbceb_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAU23OBX%252F2025-12-01%252Fimage%252F19f364bb-be75-4107-877a-6da8ff652d72_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU23OBX/2025-12-01/image/19f364bb-be75-4107-877a-6da8ff652d72_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 96670254-9e60-53c1-a1c3-3ccb32ebbceb
2025-12-01 19:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e68d8d0>
2025-12-01 19:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8860decc-d092-5183-b3ca-b40ba3560e46/8860decc-d092-5183-b3ca-b40ba3560e46_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM65NFL%252F2025-12-01%252Fimage%252F99baec5d-3d0f-4887-b275-75305120f659_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM65NFL/2025-12-01/image/99baec5d-3d0f-4887-b275-75305120f659_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8860decc-d092-5183-b3ca-b40ba3560e46
2025-12-01 19:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KO17WEX/2025-12-01/image/d87afa89-f04f-427a-b49c-2c003ea09013_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117628272?view=catalogue)
2025-12-01 19:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX69UED/2025-12-01/image/22848df7-7559-41c6-af64-ae33558efb1d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117629580?view=catalogue)
2025-12-01 19:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/cdccb1ad-e1d6-4201-aa56-dac4693cb326.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117610728?view=catalogue)
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDA68HHG%252F2025-12-01%252Fimage%252Fe3946526-6c75-400c-81ff-fd486762d859_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA68HHG/2025-12-01/image/e3946526-6c75-400c-81ff-fd486762d859_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM65NFL%252F2025-12-01%252Fimage%252F4cd35509-48c9-402a-add6-77196dc6cfe1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM65NFL/2025-12-01/image/4cd35509-48c9-402a-add6-77196dc6cfe1_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPK18ANU%252F2025-12-01%252Fimage%252Ff23f2cf3-9eec-4329-85c7-7093c5c1720c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK18ANU/2025-12-01/image/f23f2cf3-9eec-4329-85c7-7093c5c1720c_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e5cd410>
2025-12-01 19:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2820895d-4683-5acb-9ccf-a641b030a16e/2820895d-4683-5acb-9ccf-a641b030a16e_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKO17WEX%252F2025-12-01%252Fimage%252F4574be9c-18d7-43ae-be59-d6010e5e1beb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KO17WEX/2025-12-01/image/4574be9c-18d7-43ae-be59-d6010e5e1beb_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2820895d-4683-5acb-9ccf-a641b030a16e
2025-12-01 19:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e8a33d0>
2025-12-01 19:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d59180b-d1ec-5c2b-9f81-876a812e1c8f/9d59180b-d1ec-5c2b-9f81-876a812e1c8f_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX69UED%252F2025-12-01%252Fimage%252F1949faf7-250a-4f3f-a743-ce03531ac39e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX69UED/2025-12-01/image/1949faf7-250a-4f3f-a743-ce03531ac39e_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9d59180b-d1ec-5c2b-9f81-876a812e1c8f
2025-12-01 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PK18ANU/2025-12-01/image/fa6140ba-06bf-4290-88f2-9a067c8148d8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625254?view=catalogue)
2025-12-01 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DA68HHG/2025-12-01/image/15487dc9-69a1-476d-a8c4-376f906c5ab1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117621025?view=catalogue)
2025-12-01 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM65NFL/2025-12-01/image/90174c2c-176e-4233-9083-b49fc86221ae_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117638370?view=catalogue)
2025-12-01 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLX69UED%252F2025-12-01%252Fimage%252F5b910150-0143-46ba-8e53-2ca299f7768f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX69UED/2025-12-01/image/5b910150-0143-46ba-8e53-2ca299f7768f_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCT19GDV%252F2025-12-01%252Fimage%252F0b214c68-7983-4e33-883a-a1685fd57f15_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CT19GDV/2025-12-01/image/0b214c68-7983-4e33-883a-a1685fd57f15_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD20HGY%252F2025-12-01%252Fimage%252F6b8a0c4d-ce04-4e3d-934a-975232d3a771_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD20HGY/2025-12-01/image/6b8a0c4d-ce04-4e3d-934a-975232d3a771_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e611010>
2025-12-01 19:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bc2920f-55ca-53ab-84a8-db2242b7bc17/4bc2920f-55ca-53ab-84a8-db2242b7bc17_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAP23VKB%252F2025-11-25%252Fimage%252F5a35829f-1fac-48a5-9644-d6b708c9dacf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP23VKB/2025-11-25/image/5a35829f-1fac-48a5-9644-d6b708c9dacf_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4bc2920f-55ca-53ab-84a8-db2242b7bc17
2025-12-01 19:02:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4bc2920f-55ca-53ab-84a8-db2242b7bc17, skipping ID generation
2025-12-01 19:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bc2920f-55ca-53ab-84a8-db2242b7bc17 with scrape type 1
2025-12-01 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4bc2920f-55ca-53ab-84a8-db2242b7bc17 from tracking dictionaries
2025-12-01 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4bc2920f-55ca-53ab-84a8-db2242b7bc17 sending to next pipeline
2025-12-01 19:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4bc2920f-55ca-53ab-84a8-db2242b7bc17, identifier: 117185008
2025-12-01 19:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e7e4150>
2025-12-01 19:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1a8361b-a960-5c0c-86a5-26eec748d1ec/a1a8361b-a960-5c0c-86a5-26eec748d1ec_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX73WOH%252F2025-11-12%252Fimage%252F6be52a8c-6c4e-4b01-baf7-ffe57b26864f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX73WOH/2025-11-12/image/6be52a8c-6c4e-4b01-baf7-ffe57b26864f_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1a8361b-a960-5c0c-86a5-26eec748d1ec
2025-12-01 19:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e83e490>
2025-12-01 19:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc3d0ce7-7a35-5a36-9894-7cc131d3a49b/cc3d0ce7-7a35-5a36-9894-7cc131d3a49b_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLY74DXW%252F2025-11-10%252Fimage%252Fec2f2cf0-02c5-4798-90dc-ab567ad265db_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY74DXW/2025-11-10/image/ec2f2cf0-02c5-4798-90dc-ab567ad265db_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cc3d0ce7-7a35-5a36-9894-7cc131d3a49b
2025-12-01 19:02:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc3d0ce7-7a35-5a36-9894-7cc131d3a49b, skipping ID generation
2025-12-01 19:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc3d0ce7-7a35-5a36-9894-7cc131d3a49b with scrape type 1
2025-12-01 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cc3d0ce7-7a35-5a36-9894-7cc131d3a49b from tracking dictionaries
2025-12-01 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc3d0ce7-7a35-5a36-9894-7cc131d3a49b sending to next pipeline
2025-12-01 19:02:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: cc3d0ce7-7a35-5a36-9894-7cc131d3a49b, identifier: 117023136
2025-12-01 19:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD20HGY/2025-12-01/image/4362a4ee-f363-4bc1-b26b-f1e313668e52_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117622987?view=catalogue)
2025-12-01 19:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PK18ANU/2025-12-01/image/cbb8b071-c90f-45ef-9f05-5df7678a4fdc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625254?view=catalogue)
2025-12-01 19:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CT19GDV/2025-12-01/image/d8543f5d-d344-4306-b3cc-b982621bf191_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623195?view=catalogue)
2025-12-01 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDA68HHG%252F2025-12-01%252Fimage%252F37d2ad81-77e1-4637-b991-4b8a001ad17f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA68HHG/2025-12-01/image/37d2ad81-77e1-4637-b991-4b8a001ad17f_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM65NFL%252F2025-12-01%252Fimage%252Ffaba0797-2bf4-434a-9bcc-9cb6ac36d761_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM65NFL/2025-12-01/image/faba0797-2bf4-434a-9bcc-9cb6ac36d761_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPK18ANU%252F2025-12-01%252Fimage%252Fc5e5975c-eca4-472a-89d8-c60114f01127_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK18ANU/2025-12-01/image/c5e5975c-eca4-472a-89d8-c60114f01127_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4bc2920f-55ca-53ab-84a8-db2242b7bc17 with identifier: 117185008
2025-12-01 19:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4bc2920f-55ca-53ab-84a8-db2242b7bc17 with identifier: 117185008
2025-12-01 19:02:43 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4bc2920f-55ca-53ab-84a8-db2242b7bc17 with identifier: 117185008 to the API
2025-12-01 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/AP23VKB/2025-11-25/image/5a35829f-1fac-48a5-9644-d6b708c9dacf_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4bc2920f-55ca-53ab-84a8-db2242b7bc17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AP23VKB',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117185008',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 33982,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bc2920f-55ca-53ab-84a8-db2242b7bc17/4bc2920f-55ca-53ab-84a8-db2242b7bc17_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36100,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/4028a888-6714-4fe7-8672-1bfb808745ee_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bc2920f-55ca-53ab-84a8-db2242b7bc17/4bc2920f-55ca-53ab-84a8-db2242b7bc17_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34530,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/5a35829f-1fac-48a5-9644-d6b708c9dacf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bc2920f-55ca-53ab-84a8-db2242b7bc17/4bc2920f-55ca-53ab-84a8-db2242b7bc17_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31752,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/a476a35b-c2c9-4f1d-b573-70ed1785a53b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bc2920f-55ca-53ab-84a8-db2242b7bc17/4bc2920f-55ca-53ab-84a8-db2242b7bc17_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34262,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/73b8cc7a-bea7-4a20-b83b-06d3cb3603e7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bc2920f-55ca-53ab-84a8-db2242b7bc17/4bc2920f-55ca-53ab-84a8-db2242b7bc17_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35749,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/6827af7d-8ef4-40a8-83ab-6c1644cb8ac4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bc2920f-55ca-53ab-84a8-db2242b7bc17/4bc2920f-55ca-53ab-84a8-db2242b7bc17_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44355,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/40f55a5d-86b6-46c9-b3ed-6aa2fb02781e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bc2920f-55ca-53ab-84a8-db2242b7bc17/4bc2920f-55ca-53ab-84a8-db2242b7bc17_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37226,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/b2fd1c98-6d01-4cfd-abb7-8fe2365fc477_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bc2920f-55ca-53ab-84a8-db2242b7bc17/4bc2920f-55ca-53ab-84a8-db2242b7bc17_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31192,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/4c7837b0-f5ad-4a33-b31a-c23f0903389c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bc2920f-55ca-53ab-84a8-db2242b7bc17/4bc2920f-55ca-53ab-84a8-db2242b7bc17_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42708,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AP23VKB/2025-11-25/image/6704290f-a77a-4d02-81e4-97488e185212_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-18',
 'seller_name': 'Motability Operations',
 'title': 'AUDI A3 SPORTBACK 30 TFSI S Line 5dr',
 'transmission': 'manual',
 'trim': '30 TFSI S Line 5dr',
 'vin': None,
 'year': 2023}
2025-12-01 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117185008%27 HTTP/1.1" 200 None
2025-12-01 19:02:43 [astonbarclay.gb] INFO: Saving data for 117185008: {'created_time': 1764615763.855013, 'last_price_update_time': 1764615763.855024, 'auction_closing_time': 1765792800.0}
2025-12-01 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117185008') HTTP/1.1" 204 0
2025-12-01 19:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: cc3d0ce7-7a35-5a36-9894-7cc131d3a49b with identifier: 117023136
2025-12-01 19:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: cc3d0ce7-7a35-5a36-9894-7cc131d3a49b with identifier: 117023136
2025-12-01 19:02:43 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: cc3d0ce7-7a35-5a36-9894-7cc131d3a49b with identifier: 117023136 to the API
2025-12-01 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:02:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:02:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LY74DXW/2025-11-10/image/ec2f2cf0-02c5-4798-90dc-ab567ad265db_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'cc3d0ce7-7a35-5a36-9894-7cc131d3a49b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LY74DXW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117023136',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'JEEP',
 'model': 'AVENGER HATCHBACK',
 'odometer': 2143,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc3d0ce7-7a35-5a36-9894-7cc131d3a49b/cc3d0ce7-7a35-5a36-9894-7cc131d3a49b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33177,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/df9ad979-7c37-4b10-92f0-fe7e54c7045c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc3d0ce7-7a35-5a36-9894-7cc131d3a49b/cc3d0ce7-7a35-5a36-9894-7cc131d3a49b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36272,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/ec2f2cf0-02c5-4798-90dc-ab567ad265db_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc3d0ce7-7a35-5a36-9894-7cc131d3a49b/cc3d0ce7-7a35-5a36-9894-7cc131d3a49b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39017,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/56739470-ba08-4f64-985d-cec7b10b6ed0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc3d0ce7-7a35-5a36-9894-7cc131d3a49b/cc3d0ce7-7a35-5a36-9894-7cc131d3a49b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38760,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/4977023c-527b-4d14-9124-770879b828a4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc3d0ce7-7a35-5a36-9894-7cc131d3a49b/cc3d0ce7-7a35-5a36-9894-7cc131d3a49b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39192,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/53d10d18-a2e9-4433-9d71-d104163cd4c1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc3d0ce7-7a35-5a36-9894-7cc131d3a49b/cc3d0ce7-7a35-5a36-9894-7cc131d3a49b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55350,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/ce74b827-ea4f-4c56-965e-aa8d2f11a5f4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc3d0ce7-7a35-5a36-9894-7cc131d3a49b/cc3d0ce7-7a35-5a36-9894-7cc131d3a49b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42927,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/6cfe5c9f-f441-42a1-8969-c3b953eefa2e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc3d0ce7-7a35-5a36-9894-7cc131d3a49b/cc3d0ce7-7a35-5a36-9894-7cc131d3a49b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45230,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/e5867b0b-c2c6-4b63-8993-f59574ebccd2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc3d0ce7-7a35-5a36-9894-7cc131d3a49b/cc3d0ce7-7a35-5a36-9894-7cc131d3a49b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48981,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LY74DXW/2025-11-10/image/eca87a04-82a3-4493-87ff-0fe616ed978e_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-02-12',
 'seller_name': 'Motability Operations',
 'title': 'JEEP AVENGER HATCHBACK 1.2 e-Hybrid Summit 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.2 e-Hybrid Summit 5dr DCT',
 'vin': None,
 'year': 2025}
2025-12-01 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117023136%27 HTTP/1.1" 200 None
2025-12-01 19:02:44 [astonbarclay.gb] INFO: Saving data for 117023136: {'created_time': 1764615764.281568, 'last_price_update_time': 1764615764.281581, 'auction_closing_time': 1765792800.0}
2025-12-01 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117023136') HTTP/1.1" 204 0
2025-12-01 19:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f247650>
2025-12-01 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b3e037-7659-53a6-8aac-f95cdcbf00a1/a8b3e037-7659-53a6-8aac-f95cdcbf00a1_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDA68HHG%252F2025-12-01%252Fimage%252F83e19e44-00c2-4c64-8bd8-eaf6a2556ff8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA68HHG/2025-12-01/image/83e19e44-00c2-4c64-8bd8-eaf6a2556ff8_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a8b3e037-7659-53a6-8aac-f95cdcbf00a1
2025-12-01 19:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e8b4e10>
2025-12-01 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96670254-9e60-53c1-a1c3-3ccb32ebbceb/96670254-9e60-53c1-a1c3-3ccb32ebbceb_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAU23OBX%252F2025-12-01%252Fimage%252Fe5af90f2-e33e-4c3c-97ee-a6e10ff0e030_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU23OBX/2025-12-01/image/e5af90f2-e33e-4c3c-97ee-a6e10ff0e030_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 96670254-9e60-53c1-a1c3-3ccb32ebbceb
2025-12-01 19:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e777e10>
2025-12-01 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8860decc-d092-5183-b3ca-b40ba3560e46/8860decc-d092-5183-b3ca-b40ba3560e46_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM65NFL%252F2025-12-01%252Fimage%252F82bdc247-4e48-4f4f-b881-d2d364700ca5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM65NFL/2025-12-01/image/82bdc247-4e48-4f4f-b881-d2d364700ca5_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8860decc-d092-5183-b3ca-b40ba3560e46
2025-12-01 19:02:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117625569, 'registration': 'DL65YEY', 'account': 'WBA001', 'make': 'VAUXHALL', 'model': 'MERIVA ESTATE', 'derivative': '1.4T 16V Exclusiv 5dr', 'mileage': 50577, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2015-12-18', 'fuel': 'Petrol', 'motExpiry': '2026-07-27', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DL65YEY/2025-12-01/image/eb271ef4-7275-49e1-a9cd-fdef222bc9ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL65YEY/2025-12-01/image/9746eaad-1d40-4b83-b94d-1681d376489b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL65YEY/2025-12-01/image/6c93eda8-867e-465e-a360-30b445604ba3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL65YEY/2025-12-01/image/c69af0e2-4c36-4494-8bae-9b0792d89f9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL65YEY/2025-12-01/image/b8204fef-d2d0-467d-bb62-35c3d9021178_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL65YEY/2025-12-01/image/86d3aec2-736c-4c54-8c9e-435a5f6a2a3e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL65YEY/2025-12-01/image/efcded0f-9045-4fcd-b148-1c4daa8f761a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL65YEY/2025-12-01/image/c632fbac-3073-48ee-8bf1-82b49a0527b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL65YEY/2025-12-01/image/ea3f5888-2e8c-47cf-acb3-6d8a4253729b_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/18- 37K, 12/18- 39K, 12/19- 42K, 12/20- 44K, 12/21- 45K, 12/22- 46K, 11/23- 48K, 11/24- 49K, SERVICE BOOK NO STAMPS', 'remarks': 'VOSA STATES 46K, 48K, 49K, 49K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/406e2a5b-2f2c-461d-8f7c-d266c5af0fab.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117625569, 'registration': 'DL65YEY', 'account': 'WBA001', 'make': 'VAUXHALL', 'model': 'MERIVA ESTATE', 'derivative': '1.4T 16V Exclusiv 5dr', 'mileage': 50577, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2015-12-18', 'fuel': 'Petrol', 'motExpiry': '2026-07-27', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DL65YEY/2025-12-01/image/eb271ef4-7275-49e1-a9cd-fdef222bc9ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL65YEY/2025-12-01/image/9746eaad-1d40-4b83-b94d-1681d376489b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL65YEY/2025-12-01/image/6c93eda8-867e-465e-a360-30b445604ba3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL65YEY/2025-12-01/image/c69af0e2-4c36-4494-8bae-9b0792d89f9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL65YEY/2025-12-01/image/b8204fef-d2d0-467d-bb62-35c3d9021178_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL65YEY/2025-12-01/image/86d3aec2-736c-4c54-8c9e-435a5f6a2a3e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL65YEY/2025-12-01/image/efcded0f-9045-4fcd-b148-1c4daa8f761a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL65YEY/2025-12-01/image/c632fbac-3073-48ee-8bf1-82b49a0527b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DL65YEY/2025-12-01/image/ea3f5888-2e8c-47cf-acb3-6d8a4253729b_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/18- 37K, 12/18- 39K, 12/19- 42K, 12/20- 44K, 12/21- 45K, 12/22- 46K, 11/23- 48K, 11/24- 49K, SERVICE BOOK NO STAMPS', 'remarks': 'VOSA STATES 46K, 48K, 49K, 49K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/406e2a5b-2f2c-461d-8f7c-d266c5af0fab.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55b84b13-5059-5e90-832e-264f792c1794 with identifier: 117625569
2025-12-01 19:02:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55b84b13-5059-5e90-832e-264f792c1794 with scrape type 1
2025-12-01 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 55b84b13-5059-5e90-832e-264f792c1794
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDL65YEY%252F2025-12-01%252Fimage%252Feb271ef4-7275-49e1-a9cd-fdef222bc9ba_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL65YEY/2025-12-01/image/eb271ef4-7275-49e1-a9cd-fdef222bc9ba_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DA68HHG/2025-12-01/image/ae4922ab-7021-4197-a061-721d2ae60777_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117621025?view=catalogue)
2025-12-01 19:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM65NFL/2025-12-01/image/49e2ba5e-3361-4707-91a2-fd86aba16894_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117638370?view=catalogue)
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCT19GDV%252F2025-12-01%252Fimage%252Fb08bdcc8-f2c8-4bf8-a9b7-3d0a115079fc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CT19GDV/2025-12-01/image/b08bdcc8-f2c8-4bf8-a9b7-3d0a115079fc_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD20HGY%252F2025-12-01%252Fimage%252Fe153a2c1-dfb2-4b01-815d-f20798392446_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD20HGY/2025-12-01/image/e153a2c1-dfb2-4b01-815d-f20798392446_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f50643d05d0>
2025-12-01 19:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2820895d-4683-5acb-9ccf-a641b030a16e/2820895d-4683-5acb-9ccf-a641b030a16e_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKO17WEX%252F2025-12-01%252Fimage%252Fd87afa89-f04f-427a-b49c-2c003ea09013_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KO17WEX/2025-12-01/image/d87afa89-f04f-427a-b49c-2c003ea09013_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2820895d-4683-5acb-9ccf-a641b030a16e
2025-12-01 19:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e98fcd0>
2025-12-01 19:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d59180b-d1ec-5c2b-9f81-876a812e1c8f/9d59180b-d1ec-5c2b-9f81-876a812e1c8f_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX69UED%252F2025-12-01%252Fimage%252F22848df7-7559-41c6-af64-ae33558efb1d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX69UED/2025-12-01/image/22848df7-7559-41c6-af64-ae33558efb1d_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9d59180b-d1ec-5c2b-9f81-876a812e1c8f
2025-12-01 19:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e671f50>
2025-12-01 19:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4471d1-1330-5f18-bc6b-f50165d7cebc/9b4471d1-1330-5f18-bc6b-f50165d7cebc_image_11.jpg HTTP/1.1" 201 0
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fcdccb1ad-e1d6-4201-aa56-dac4693cb326.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/cdccb1ad-e1d6-4201-aa56-dac4693cb326.jpg?w=600 saved to cache
2025-12-01 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9b4471d1-1330-5f18-bc6b-f50165d7cebc
2025-12-01 19:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD20HGY/2025-12-01/image/b92be8cd-5cc5-4eb3-a8a9-f14ca1587f2d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117622987?view=catalogue)
2025-12-01 19:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX69UED/2025-12-01/image/a82b318a-d426-4d88-bf0e-d0cea6434722_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117629580?view=catalogue)
2025-12-01 19:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CT19GDV/2025-12-01/image/f5ca84ab-0d04-44a5-81e3-af851f931e89_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623195?view=catalogue)
2025-12-01 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FWM65NFL%252F2025-12-01%252Fimage%252F29f2f161-cc7f-494e-be66-5c5f7a1fdc3f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM65NFL/2025-12-01/image/29f2f161-cc7f-494e-be66-5c5f7a1fdc3f_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPK18ANU%252F2025-12-01%252Fimage%252F84b0205b-d81e-4fda-96e2-5ed8e4999d56_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK18ANU/2025-12-01/image/84b0205b-d81e-4fda-96e2-5ed8e4999d56_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDL65YEY%252F2025-12-01%252Fimage%252F9746eaad-1d40-4b83-b94d-1681d376489b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL65YEY/2025-12-01/image/9746eaad-1d40-4b83-b94d-1681d376489b_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e424750>
2025-12-01 19:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9a2d1f-5d0f-5846-b610-9c0e398774d5/3f9a2d1f-5d0f-5846-b610-9c0e398774d5_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPK18ANU%252F2025-12-01%252Fimage%252Ffa6140ba-06bf-4290-88f2-9a067c8148d8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK18ANU/2025-12-01/image/fa6140ba-06bf-4290-88f2-9a067c8148d8_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f9a2d1f-5d0f-5846-b610-9c0e398774d5
2025-12-01 19:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e518050>
2025-12-01 19:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b3e037-7659-53a6-8aac-f95cdcbf00a1/a8b3e037-7659-53a6-8aac-f95cdcbf00a1_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDA68HHG%252F2025-12-01%252Fimage%252F15487dc9-69a1-476d-a8c4-376f906c5ab1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA68HHG/2025-12-01/image/15487dc9-69a1-476d-a8c4-376f906c5ab1_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a8b3e037-7659-53a6-8aac-f95cdcbf00a1
2025-12-01 19:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e759f50>
2025-12-01 19:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8860decc-d092-5183-b3ca-b40ba3560e46/8860decc-d092-5183-b3ca-b40ba3560e46_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM65NFL%252F2025-12-01%252Fimage%252F90174c2c-176e-4233-9083-b49fc86221ae_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM65NFL/2025-12-01/image/90174c2c-176e-4233-9083-b49fc86221ae_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8860decc-d092-5183-b3ca-b40ba3560e46
2025-12-01 19:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PK18ANU/2025-12-01/image/ced25ed9-c49f-4bdd-8164-b56a0881dae7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625254?view=catalogue)
2025-12-01 19:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DA68HHG/2025-12-01/image/6ad03bcc-9401-477d-b335-b28bff4193a4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117621025?view=catalogue)
2025-12-01 19:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM65NFL/2025-12-01/image/cb1377ee-50e8-4c26-b3df-c625d437a5c7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117638370?view=catalogue)
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCT19GDV%252F2025-12-01%252Fimage%252F53a278b7-eb92-42b1-9130-537dc5be2863_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CT19GDV/2025-12-01/image/53a278b7-eb92-42b1-9130-537dc5be2863_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD20HGY%252F2025-12-01%252Fimage%252Fd8ad4aa4-41a9-4151-9148-8e85e2a81ca4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD20HGY/2025-12-01/image/d8ad4aa4-41a9-4151-9148-8e85e2a81ca4_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e54d0d0>
2025-12-01 19:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba/ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD20HGY%252F2025-12-01%252Fimage%252F4362a4ee-f363-4bc1-b26b-f1e313668e52_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD20HGY/2025-12-01/image/4362a4ee-f363-4bc1-b26b-f1e313668e52_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba
2025-12-01 19:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e7b8c10>
2025-12-01 19:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9a2d1f-5d0f-5846-b610-9c0e398774d5/3f9a2d1f-5d0f-5846-b610-9c0e398774d5_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPK18ANU%252F2025-12-01%252Fimage%252Fcbb8b071-c90f-45ef-9f05-5df7678a4fdc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK18ANU/2025-12-01/image/cbb8b071-c90f-45ef-9f05-5df7678a4fdc_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f9a2d1f-5d0f-5846-b610-9c0e398774d5
2025-12-01 19:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f215790>
2025-12-01 19:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59764ae9-5e5a-5748-b4ed-bf9aea82270a/59764ae9-5e5a-5748-b4ed-bf9aea82270a_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCT19GDV%252F2025-12-01%252Fimage%252Fd8543f5d-d344-4306-b3cc-b982621bf191_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CT19GDV/2025-12-01/image/d8543f5d-d344-4306-b3cc-b982621bf191_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 59764ae9-5e5a-5748-b4ed-bf9aea82270a
2025-12-01 19:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD20HGY/2025-12-01/image/2bd50cf9-cd59-4b53-9074-21b1e65b944d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117622987?view=catalogue)
2025-12-01 19:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX69UED/2025-12-01/image/3060d354-32c1-43e1-a34f-327d14864a9f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117629580?view=catalogue)
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPK18ANU%252F2025-12-01%252Fimage%252Fcb2957d0-de69-476f-978a-4bb05a04478c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK18ANU/2025-12-01/image/cb2957d0-de69-476f-978a-4bb05a04478c_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDL65YEY%252F2025-12-01%252Fimage%252F6c93eda8-867e-465e-a360-30b445604ba3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL65YEY/2025-12-01/image/6c93eda8-867e-465e-a360-30b445604ba3_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e5a2e10>
2025-12-01 19:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b3e037-7659-53a6-8aac-f95cdcbf00a1/a8b3e037-7659-53a6-8aac-f95cdcbf00a1_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDA68HHG%252F2025-12-01%252Fimage%252Fae4922ab-7021-4197-a061-721d2ae60777_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA68HHG/2025-12-01/image/ae4922ab-7021-4197-a061-721d2ae60777_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a8b3e037-7659-53a6-8aac-f95cdcbf00a1
2025-12-01 19:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f50643ea210>
2025-12-01 19:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8860decc-d092-5183-b3ca-b40ba3560e46/8860decc-d092-5183-b3ca-b40ba3560e46_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM65NFL%252F2025-12-01%252Fimage%252F49e2ba5e-3361-4707-91a2-fd86aba16894_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM65NFL/2025-12-01/image/49e2ba5e-3361-4707-91a2-fd86aba16894_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8860decc-d092-5183-b3ca-b40ba3560e46
2025-12-01 19:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PK18ANU/2025-12-01/image/f23f2cf3-9eec-4329-85c7-7093c5c1720c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625254?view=catalogue)
2025-12-01 19:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CT19GDV/2025-12-01/image/182b8f7b-9db3-4c36-ad59-07f3851f07ef_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623195?view=catalogue)
2025-12-01 19:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX69UED/2025-12-01/image/4f05a703-eb66-4353-8185-cbd14f32f981_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117629580?view=catalogue)
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCT19GDV%252F2025-12-01%252Fimage%252Fedb0841f-cd24-4e3c-aacb-2b6113cc462d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CT19GDV/2025-12-01/image/edb0841f-cd24-4e3c-aacb-2b6113cc462d_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD20HGY%252F2025-12-01%252Fimage%252F97c3c506-318a-47a0-9dea-ef3ecf231b9b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD20HGY/2025-12-01/image/97c3c506-318a-47a0-9dea-ef3ecf231b9b_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117627785?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e69aad0>
2025-12-01 19:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba/ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD20HGY%252F2025-12-01%252Fimage%252Fb92be8cd-5cc5-4eb3-a8a9-f14ca1587f2d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD20HGY/2025-12-01/image/b92be8cd-5cc5-4eb3-a8a9-f14ca1587f2d_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba
2025-12-01 19:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5064413f50>
2025-12-01 19:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d59180b-d1ec-5c2b-9f81-876a812e1c8f/9d59180b-d1ec-5c2b-9f81-876a812e1c8f_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX69UED%252F2025-12-01%252Fimage%252Fa82b318a-d426-4d88-bf0e-d0cea6434722_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX69UED/2025-12-01/image/a82b318a-d426-4d88-bf0e-d0cea6434722_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9d59180b-d1ec-5c2b-9f81-876a812e1c8f
2025-12-01 19:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e5cae10>
2025-12-01 19:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59764ae9-5e5a-5748-b4ed-bf9aea82270a/59764ae9-5e5a-5748-b4ed-bf9aea82270a_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCT19GDV%252F2025-12-01%252Fimage%252Ff5ca84ab-0d04-44a5-81e3-af851f931e89_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CT19GDV/2025-12-01/image/f5ca84ab-0d04-44a5-81e3-af851f931e89_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 59764ae9-5e5a-5748-b4ed-bf9aea82270a
2025-12-01 19:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DA68HHG/2025-12-01/image/e3946526-6c75-400c-81ff-fd486762d859_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117621025?view=catalogue)
2025-12-01 19:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD20HGY/2025-12-01/image/6b8a0c4d-ce04-4e3d-934a-975232d3a771_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117622987?view=catalogue)
2025-12-01 19:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM65NFL/2025-12-01/image/4cd35509-48c9-402a-add6-77196dc6cfe1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117638370?view=catalogue)
2025-12-01 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPK18ANU%252F2025-12-01%252Fimage%252F8db11a3b-e74d-4b44-8448-e50fdea3d811_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK18ANU/2025-12-01/image/8db11a3b-e74d-4b44-8448-e50fdea3d811_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDL65YEY%252F2025-12-01%252Fimage%252Fc69af0e2-4c36-4494-8bae-9b0792d89f9d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL65YEY/2025-12-01/image/c69af0e2-4c36-4494-8bae-9b0792d89f9d_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f2cd9d0>
2025-12-01 19:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9a2d1f-5d0f-5846-b610-9c0e398774d5/3f9a2d1f-5d0f-5846-b610-9c0e398774d5_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPK18ANU%252F2025-12-01%252Fimage%252Fced25ed9-c49f-4bdd-8164-b56a0881dae7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK18ANU/2025-12-01/image/ced25ed9-c49f-4bdd-8164-b56a0881dae7_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f9a2d1f-5d0f-5846-b610-9c0e398774d5
2025-12-01 19:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e827b90>
2025-12-01 19:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b3e037-7659-53a6-8aac-f95cdcbf00a1/a8b3e037-7659-53a6-8aac-f95cdcbf00a1_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDA68HHG%252F2025-12-01%252Fimage%252F6ad03bcc-9401-477d-b335-b28bff4193a4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA68HHG/2025-12-01/image/6ad03bcc-9401-477d-b335-b28bff4193a4_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a8b3e037-7659-53a6-8aac-f95cdcbf00a1
2025-12-01 19:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e71c890>
2025-12-01 19:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8860decc-d092-5183-b3ca-b40ba3560e46/8860decc-d092-5183-b3ca-b40ba3560e46_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM65NFL%252F2025-12-01%252Fimage%252Fcb1377ee-50e8-4c26-b3df-c625d437a5c7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM65NFL/2025-12-01/image/cb1377ee-50e8-4c26-b3df-c625d437a5c7_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8860decc-d092-5183-b3ca-b40ba3560e46
2025-12-01 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DL65YEY/2025-12-01/image/eb271ef4-7275-49e1-a9cd-fdef222bc9ba_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625569?view=catalogue)
2025-12-01 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CT19GDV/2025-12-01/image/0b214c68-7983-4e33-883a-a1685fd57f15_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623195?view=catalogue)
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCT19GDV%252F2025-12-01%252Fimage%252F619608df-95c0-4ecf-b1d2-f83012bf3816_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CT19GDV/2025-12-01/image/619608df-95c0-4ecf-b1d2-f83012bf3816_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD20HGY%252F2025-12-01%252Fimage%252F1fe48c30-f3fb-44bd-ae34-d894d8e15a2a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD20HGY/2025-12-01/image/1fe48c30-f3fb-44bd-ae34-d894d8e15a2a_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e40fad0>
2025-12-01 19:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba/ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD20HGY%252F2025-12-01%252Fimage%252F2bd50cf9-cd59-4b53-9074-21b1e65b944d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD20HGY/2025-12-01/image/2bd50cf9-cd59-4b53-9074-21b1e65b944d_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba
2025-12-01 19:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e5ca250>
2025-12-01 19:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d59180b-d1ec-5c2b-9f81-876a812e1c8f/9d59180b-d1ec-5c2b-9f81-876a812e1c8f_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX69UED%252F2025-12-01%252Fimage%252F3060d354-32c1-43e1-a34f-327d14864a9f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX69UED/2025-12-01/image/3060d354-32c1-43e1-a34f-327d14864a9f_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9d59180b-d1ec-5c2b-9f81-876a812e1c8f
2025-12-01 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PK18ANU/2025-12-01/image/c5e5975c-eca4-472a-89d8-c60114f01127_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625254?view=catalogue)
2025-12-01 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD20HGY/2025-12-01/image/e153a2c1-dfb2-4b01-815d-f20798392446_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117622987?view=catalogue)
2025-12-01 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM65NFL/2025-12-01/image/faba0797-2bf4-434a-9bcc-9cb6ac36d761_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117638370?view=catalogue)
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPK18ANU%252F2025-12-01%252Fimage%252Ffd8bd7f3-e8a5-4517-9f61-7516fc265415_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK18ANU/2025-12-01/image/fd8bd7f3-e8a5-4517-9f61-7516fc265415_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDL65YEY%252F2025-12-01%252Fimage%252Fb8204fef-d2d0-467d-bb62-35c3d9021178_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL65YEY/2025-12-01/image/b8204fef-d2d0-467d-bb62-35c3d9021178_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6c1850>
2025-12-01 19:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9a2d1f-5d0f-5846-b610-9c0e398774d5/3f9a2d1f-5d0f-5846-b610-9c0e398774d5_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPK18ANU%252F2025-12-01%252Fimage%252Ff23f2cf3-9eec-4329-85c7-7093c5c1720c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK18ANU/2025-12-01/image/f23f2cf3-9eec-4329-85c7-7093c5c1720c_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f9a2d1f-5d0f-5846-b610-9c0e398774d5
2025-12-01 19:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f263610>
2025-12-01 19:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59764ae9-5e5a-5748-b4ed-bf9aea82270a/59764ae9-5e5a-5748-b4ed-bf9aea82270a_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCT19GDV%252F2025-12-01%252Fimage%252F182b8f7b-9db3-4c36-ad59-07f3851f07ef_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CT19GDV/2025-12-01/image/182b8f7b-9db3-4c36-ad59-07f3851f07ef_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 59764ae9-5e5a-5748-b4ed-bf9aea82270a
2025-12-01 19:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e5284d0>
2025-12-01 19:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d59180b-d1ec-5c2b-9f81-876a812e1c8f/9d59180b-d1ec-5c2b-9f81-876a812e1c8f_image_9.jpg HTTP/1.1" 201 0
2025-12-01 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX69UED%252F2025-12-01%252Fimage%252F4f05a703-eb66-4353-8185-cbd14f32f981_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX69UED/2025-12-01/image/4f05a703-eb66-4353-8185-cbd14f32f981_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9d59180b-d1ec-5c2b-9f81-876a812e1c8f
2025-12-01 19:02:51 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117627785, 'registration': 'EO18JKK', 'account': 'WBA001', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK SPECIAL EDS', 'derivative': '1.4 [75] Energy 3dr [AC]', 'mileage': 43837, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2018-03-17', 'fuel': 'Petrol', 'motExpiry': '2026-04-11', 'doors': 3, 'engineSize': 1398, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EO18JKK/2025-12-01/image/27bdd94b-539b-43ec-8eb3-81352cde3a3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18JKK/2025-12-01/image/3c4691bd-fb61-462a-9086-21c16a0b53d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18JKK/2025-12-01/image/268e3f56-ac14-49f2-8157-af1c1f3fb1b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18JKK/2025-12-01/image/36deaa9e-ee8a-4a96-b565-1114285a10ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18JKK/2025-12-01/image/32cc8eb7-bec7-4cd4-9227-a31ae252f49c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18JKK/2025-12-01/image/b43f7eb7-bd59-43c4-932b-7aad6701dfd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18JKK/2025-12-01/image/874341f9-f211-491b-87ca-e9698be01f8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18JKK/2025-12-01/image/3f5ead84-988d-41cf-8cf5-0a15dfd879f5_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/19- 4K, 09/20- 9K, 04/21- 10K, 03/22- 17K, 06/23- 23K, 05/24- 30K', 'remarks': 'VOSA STATES 17K, 22K, 29K, 38K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/131d89e8-0440-435d-b656-5f54b8629ac7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:51 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117627785, 'registration': 'EO18JKK', 'account': 'WBA001', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK SPECIAL EDS', 'derivative': '1.4 [75] Energy 3dr [AC]', 'mileage': 43837, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2018-03-17', 'fuel': 'Petrol', 'motExpiry': '2026-04-11', 'doors': 3, 'engineSize': 1398, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EO18JKK/2025-12-01/image/27bdd94b-539b-43ec-8eb3-81352cde3a3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18JKK/2025-12-01/image/3c4691bd-fb61-462a-9086-21c16a0b53d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18JKK/2025-12-01/image/268e3f56-ac14-49f2-8157-af1c1f3fb1b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18JKK/2025-12-01/image/36deaa9e-ee8a-4a96-b565-1114285a10ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18JKK/2025-12-01/image/32cc8eb7-bec7-4cd4-9227-a31ae252f49c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18JKK/2025-12-01/image/b43f7eb7-bd59-43c4-932b-7aad6701dfd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18JKK/2025-12-01/image/874341f9-f211-491b-87ca-e9698be01f8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO18JKK/2025-12-01/image/3f5ead84-988d-41cf-8cf5-0a15dfd879f5_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/19- 4K, 09/20- 9K, 04/21- 10K, 03/22- 17K, 06/23- 23K, 05/24- 30K', 'remarks': 'VOSA STATES 17K, 22K, 29K, 38K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/131d89e8-0440-435d-b656-5f54b8629ac7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28b82772-9067-5549-932e-76f41c49ba19 with identifier: 117627785
2025-12-01 19:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28b82772-9067-5549-932e-76f41c49ba19 with scrape type 1
2025-12-01 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 28b82772-9067-5549-932e-76f41c49ba19
2025-12-01 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO18JKK%252F2025-12-01%252Fimage%252F27bdd94b-539b-43ec-8eb3-81352cde3a3c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO18JKK/2025-12-01/image/27bdd94b-539b-43ec-8eb3-81352cde3a3c_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PK18ANU/2025-12-01/image/84b0205b-d81e-4fda-96e2-5ed8e4999d56_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625254?view=catalogue)
2025-12-01 19:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DA68HHG/2025-12-01/image/37d2ad81-77e1-4637-b991-4b8a001ad17f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117621025?view=catalogue)
2025-12-01 19:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CT19GDV/2025-12-01/image/b08bdcc8-f2c8-4bf8-a9b7-3d0a115079fc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623195?view=catalogue)
2025-12-01 19:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DL65YEY/2025-12-01/image/9746eaad-1d40-4b83-b94d-1681d376489b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625569?view=catalogue)
2025-12-01 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCT19GDV%252F2025-12-01%252Fimage%252Ff4980e63-bb7e-4ab4-92a5-d151785a28f7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CT19GDV/2025-12-01/image/f4980e63-bb7e-4ab4-92a5-d151785a28f7_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FSD20HGY%252F2025-12-01%252Fimage%252Faf4932b7-fbfc-4ebf-b795-3509880f628d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD20HGY/2025-12-01/image/af4932b7-fbfc-4ebf-b795-3509880f628d_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e847fd0>
2025-12-01 19:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b3e037-7659-53a6-8aac-f95cdcbf00a1/a8b3e037-7659-53a6-8aac-f95cdcbf00a1_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDA68HHG%252F2025-12-01%252Fimage%252Fe3946526-6c75-400c-81ff-fd486762d859_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA68HHG/2025-12-01/image/e3946526-6c75-400c-81ff-fd486762d859_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a8b3e037-7659-53a6-8aac-f95cdcbf00a1
2025-12-01 19:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e88c610>
2025-12-01 19:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba/ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD20HGY%252F2025-12-01%252Fimage%252F6b8a0c4d-ce04-4e3d-934a-975232d3a771_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD20HGY/2025-12-01/image/6b8a0c4d-ce04-4e3d-934a-975232d3a771_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba
2025-12-01 19:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e8eab10>
2025-12-01 19:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8860decc-d092-5183-b3ca-b40ba3560e46/8860decc-d092-5183-b3ca-b40ba3560e46_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM65NFL%252F2025-12-01%252Fimage%252F4cd35509-48c9-402a-add6-77196dc6cfe1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM65NFL/2025-12-01/image/4cd35509-48c9-402a-add6-77196dc6cfe1_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8860decc-d092-5183-b3ca-b40ba3560e46
2025-12-01 19:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD20HGY/2025-12-01/image/d8ad4aa4-41a9-4151-9148-8e85e2a81ca4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117622987?view=catalogue)
2025-12-01 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPK18ANU%252F2025-12-01%252Fimage%252F12fe1d66-65e9-4e58-a7f9-1575c7715089_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK18ANU/2025-12-01/image/12fe1d66-65e9-4e58-a7f9-1575c7715089_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDL65YEY%252F2025-12-01%252Fimage%252F86d3aec2-736c-4c54-8c9e-435a5f6a2a3e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL65YEY/2025-12-01/image/86d3aec2-736c-4c54-8c9e-435a5f6a2a3e_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO18JKK%252F2025-12-01%252Fimage%252F3c4691bd-fb61-462a-9086-21c16a0b53d6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO18JKK/2025-12-01/image/3c4691bd-fb61-462a-9086-21c16a0b53d6_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e685690>
2025-12-01 19:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55b84b13-5059-5e90-832e-264f792c1794/55b84b13-5059-5e90-832e-264f792c1794_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDL65YEY%252F2025-12-01%252Fimage%252Feb271ef4-7275-49e1-a9cd-fdef222bc9ba_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL65YEY/2025-12-01/image/eb271ef4-7275-49e1-a9cd-fdef222bc9ba_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55b84b13-5059-5e90-832e-264f792c1794
2025-12-01 19:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6873d0>
2025-12-01 19:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59764ae9-5e5a-5748-b4ed-bf9aea82270a/59764ae9-5e5a-5748-b4ed-bf9aea82270a_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCT19GDV%252F2025-12-01%252Fimage%252F0b214c68-7983-4e33-883a-a1685fd57f15_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CT19GDV/2025-12-01/image/0b214c68-7983-4e33-883a-a1685fd57f15_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 59764ae9-5e5a-5748-b4ed-bf9aea82270a
2025-12-01 19:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM65NFL/2025-12-01/image/29f2f161-cc7f-494e-be66-5c5f7a1fdc3f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117638370?view=catalogue)
2025-12-01 19:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CT19GDV/2025-12-01/image/53a278b7-eb92-42b1-9130-537dc5be2863_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623195?view=catalogue)
2025-12-01 19:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DL65YEY/2025-12-01/image/6c93eda8-867e-465e-a360-30b445604ba3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625569?view=catalogue)
2025-12-01 19:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e84bc50>
2025-12-01 19:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9a2d1f-5d0f-5846-b610-9c0e398774d5/3f9a2d1f-5d0f-5846-b610-9c0e398774d5_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPK18ANU%252F2025-12-01%252Fimage%252Fc5e5975c-eca4-472a-89d8-c60114f01127_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK18ANU/2025-12-01/image/c5e5975c-eca4-472a-89d8-c60114f01127_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f9a2d1f-5d0f-5846-b610-9c0e398774d5
2025-12-01 19:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e63a8d0>
2025-12-01 19:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba/ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD20HGY%252F2025-12-01%252Fimage%252Fe153a2c1-dfb2-4b01-815d-f20798392446_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD20HGY/2025-12-01/image/e153a2c1-dfb2-4b01-815d-f20798392446_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba
2025-12-01 19:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e77d950>
2025-12-01 19:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8860decc-d092-5183-b3ca-b40ba3560e46/8860decc-d092-5183-b3ca-b40ba3560e46_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM65NFL%252F2025-12-01%252Fimage%252Ffaba0797-2bf4-434a-9bcc-9cb6ac36d761_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM65NFL/2025-12-01/image/faba0797-2bf4-434a-9bcc-9cb6ac36d761_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8860decc-d092-5183-b3ca-b40ba3560e46
2025-12-01 19:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PK18ANU/2025-12-01/image/cb2957d0-de69-476f-978a-4bb05a04478c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625254?view=catalogue)
2025-12-01 19:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KO17WEX/2025-12-01/image/d42d7de0-9cb4-4c4e-a5a5-91cc07f29fe6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117628272?view=catalogue)
2025-12-01 19:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD20HGY/2025-12-01/image/97c3c506-318a-47a0-9dea-ef3ecf231b9b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117622987?view=catalogue)
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPK18ANU%252F2025-12-01%252Fimage%252Ff7c371da-7154-457a-89df-bc46f97ade8a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK18ANU/2025-12-01/image/f7c371da-7154-457a-89df-bc46f97ade8a_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDL65YEY%252F2025-12-01%252Fimage%252Fefcded0f-9045-4fcd-b148-1c4daa8f761a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL65YEY/2025-12-01/image/efcded0f-9045-4fcd-b148-1c4daa8f761a_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO18JKK%252F2025-12-01%252Fimage%252F268e3f56-ac14-49f2-8157-af1c1f3fb1b2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO18JKK/2025-12-01/image/268e3f56-ac14-49f2-8157-af1c1f3fb1b2_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e625ed0>
2025-12-01 19:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9a2d1f-5d0f-5846-b610-9c0e398774d5/3f9a2d1f-5d0f-5846-b610-9c0e398774d5_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPK18ANU%252F2025-12-01%252Fimage%252F84b0205b-d81e-4fda-96e2-5ed8e4999d56_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK18ANU/2025-12-01/image/84b0205b-d81e-4fda-96e2-5ed8e4999d56_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3f9a2d1f-5d0f-5846-b610-9c0e398774d5
2025-12-01 19:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e77d050>
2025-12-01 19:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b3e037-7659-53a6-8aac-f95cdcbf00a1/a8b3e037-7659-53a6-8aac-f95cdcbf00a1_image_9.jpg HTTP/1.1" 201 0
2025-12-01 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDA68HHG%252F2025-12-01%252Fimage%252F37d2ad81-77e1-4637-b991-4b8a001ad17f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DA68HHG/2025-12-01/image/37d2ad81-77e1-4637-b991-4b8a001ad17f_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a8b3e037-7659-53a6-8aac-f95cdcbf00a1
2025-12-01 19:02:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a8b3e037-7659-53a6-8aac-f95cdcbf00a1, skipping ID generation
2025-12-01 19:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8b3e037-7659-53a6-8aac-f95cdcbf00a1 with scrape type 1
2025-12-01 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a8b3e037-7659-53a6-8aac-f95cdcbf00a1 from tracking dictionaries
2025-12-01 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a8b3e037-7659-53a6-8aac-f95cdcbf00a1 sending to next pipeline
2025-12-01 19:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a8b3e037-7659-53a6-8aac-f95cdcbf00a1, identifier: 117621025
2025-12-01 19:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e84b1d0>
2025-12-01 19:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59764ae9-5e5a-5748-b4ed-bf9aea82270a/59764ae9-5e5a-5748-b4ed-bf9aea82270a_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCT19GDV%252F2025-12-01%252Fimage%252Fb08bdcc8-f2c8-4bf8-a9b7-3d0a115079fc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CT19GDV/2025-12-01/image/b08bdcc8-f2c8-4bf8-a9b7-3d0a115079fc_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 59764ae9-5e5a-5748-b4ed-bf9aea82270a
2025-12-01 19:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f28d410>
2025-12-01 19:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55b84b13-5059-5e90-832e-264f792c1794/55b84b13-5059-5e90-832e-264f792c1794_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDL65YEY%252F2025-12-01%252Fimage%252F9746eaad-1d40-4b83-b94d-1681d376489b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL65YEY/2025-12-01/image/9746eaad-1d40-4b83-b94d-1681d376489b_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55b84b13-5059-5e90-832e-264f792c1794
2025-12-01 19:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CT19GDV/2025-12-01/image/edb0841f-cd24-4e3c-aacb-2b6113cc462d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623195?view=catalogue)
2025-12-01 19:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX69UED/2025-12-01/image/5b910150-0143-46ba-8e53-2ca299f7768f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117629580?view=catalogue)
2025-12-01 19:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a8b3e037-7659-53a6-8aac-f95cdcbf00a1 with identifier: 117621025
2025-12-01 19:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a8b3e037-7659-53a6-8aac-f95cdcbf00a1 with identifier: 117621025
2025-12-01 19:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a8b3e037-7659-53a6-8aac-f95cdcbf00a1 with identifier: 117621025 to the API
2025-12-01 19:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DA68HHG/2025-12-01/image/37d2ad81-77e1-4637-b991-4b8a001ad17f_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'a8b3e037-7659-53a6-8aac-f95cdcbf00a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DA68HHG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117621025',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'SKODA',
 'model': 'KODIAQ ESTATE',
 'odometer': 62846,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b3e037-7659-53a6-8aac-f95cdcbf00a1/a8b3e037-7659-53a6-8aac-f95cdcbf00a1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39814,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DA68HHG/2025-12-01/image/e20953c5-178e-4304-89c3-a85f9a2f5205_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b3e037-7659-53a6-8aac-f95cdcbf00a1/a8b3e037-7659-53a6-8aac-f95cdcbf00a1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43691,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DA68HHG/2025-12-01/image/0fd9ca43-0a7d-4874-bbfe-542172157475_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b3e037-7659-53a6-8aac-f95cdcbf00a1/a8b3e037-7659-53a6-8aac-f95cdcbf00a1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38112,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DA68HHG/2025-12-01/image/8f3f792e-ab1a-4b82-bd86-c639772865ab_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b3e037-7659-53a6-8aac-f95cdcbf00a1/a8b3e037-7659-53a6-8aac-f95cdcbf00a1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39488,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DA68HHG/2025-12-01/image/30a8f0d6-17d2-410d-8556-ffe1b5e48fd6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b3e037-7659-53a6-8aac-f95cdcbf00a1/a8b3e037-7659-53a6-8aac-f95cdcbf00a1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46688,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DA68HHG/2025-12-01/image/83e19e44-00c2-4c64-8bd8-eaf6a2556ff8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b3e037-7659-53a6-8aac-f95cdcbf00a1/a8b3e037-7659-53a6-8aac-f95cdcbf00a1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46280,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DA68HHG/2025-12-01/image/15487dc9-69a1-476d-a8c4-376f906c5ab1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b3e037-7659-53a6-8aac-f95cdcbf00a1/a8b3e037-7659-53a6-8aac-f95cdcbf00a1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60029,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DA68HHG/2025-12-01/image/ae4922ab-7021-4197-a061-721d2ae60777_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b3e037-7659-53a6-8aac-f95cdcbf00a1/a8b3e037-7659-53a6-8aac-f95cdcbf00a1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49112,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DA68HHG/2025-12-01/image/6ad03bcc-9401-477d-b335-b28bff4193a4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b3e037-7659-53a6-8aac-f95cdcbf00a1/a8b3e037-7659-53a6-8aac-f95cdcbf00a1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40847,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DA68HHG/2025-12-01/image/e3946526-6c75-400c-81ff-fd486762d859_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b3e037-7659-53a6-8aac-f95cdcbf00a1/a8b3e037-7659-53a6-8aac-f95cdcbf00a1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46599,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DA68HHG/2025-12-01/image/37d2ad81-77e1-4637-b991-4b8a001ad17f_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-27',
 'seller_name': 'UKCGR',
 'title': 'SKODA KODIAQ ESTATE 1.5 TSI Edition 5dr DSG [7 Seat]',
 'transmission': 'automatic',
 'trim': '1.5 TSI Edition 5dr DSG [7 Seat]',
 'vin': None,
 'year': 2018}
2025-12-01 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117621025%27 HTTP/1.1" 200 None
2025-12-01 19:02:55 [astonbarclay.gb] INFO: Saving data for 117621025: {'created_time': 1764615775.56834, 'last_price_update_time': 1764615775.568351}
2025-12-01 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117621025') HTTP/1.1" 204 0
2025-12-01 19:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e80ebd0>
2025-12-01 19:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba/ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD20HGY%252F2025-12-01%252Fimage%252Fd8ad4aa4-41a9-4151-9148-8e85e2a81ca4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD20HGY/2025-12-01/image/d8ad4aa4-41a9-4151-9148-8e85e2a81ca4_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba
2025-12-01 19:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AU23OBX/2025-12-01/image/a7e4ea61-c38b-46fc-a4e4-e94d5232e13b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634646?view=catalogue)
2025-12-01 19:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DL65YEY/2025-12-01/image/c69af0e2-4c36-4494-8bae-9b0792d89f9d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625569?view=catalogue)
2025-12-01 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPK18ANU%252F2025-12-01%252Fimage%252F4f7deb18-1649-472f-9cf3-3497394c3c9c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK18ANU/2025-12-01/image/4f7deb18-1649-472f-9cf3-3497394c3c9c_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDL65YEY%252F2025-12-01%252Fimage%252Fc632fbac-3073-48ee-8bf1-82b49a0527b2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL65YEY/2025-12-01/image/c632fbac-3073-48ee-8bf1-82b49a0527b2_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO18JKK%252F2025-12-01%252Fimage%252F36deaa9e-ee8a-4a96-b565-1114285a10ec_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO18JKK/2025-12-01/image/36deaa9e-ee8a-4a96-b565-1114285a10ec_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e848dd0>
2025-12-01 19:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-01 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8860decc-d092-5183-b3ca-b40ba3560e46/8860decc-d092-5183-b3ca-b40ba3560e46_image_9.jpg HTTP/1.1" 201 0
2025-12-01 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM65NFL%252F2025-12-01%252Fimage%252F29f2f161-cc7f-494e-be66-5c5f7a1fdc3f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM65NFL/2025-12-01/image/29f2f161-cc7f-494e-be66-5c5f7a1fdc3f_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8860decc-d092-5183-b3ca-b40ba3560e46
2025-12-01 19:02:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8860decc-d092-5183-b3ca-b40ba3560e46, skipping ID generation
2025-12-01 19:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8860decc-d092-5183-b3ca-b40ba3560e46 with scrape type 1
2025-12-01 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8860decc-d092-5183-b3ca-b40ba3560e46 from tracking dictionaries
2025-12-01 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8860decc-d092-5183-b3ca-b40ba3560e46 sending to next pipeline
2025-12-01 19:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8860decc-d092-5183-b3ca-b40ba3560e46, identifier: 117638370
2025-12-01 19:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f28d990>
2025-12-01 19:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59764ae9-5e5a-5748-b4ed-bf9aea82270a/59764ae9-5e5a-5748-b4ed-bf9aea82270a_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCT19GDV%252F2025-12-01%252Fimage%252F53a278b7-eb92-42b1-9130-537dc5be2863_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CT19GDV/2025-12-01/image/53a278b7-eb92-42b1-9130-537dc5be2863_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 59764ae9-5e5a-5748-b4ed-bf9aea82270a
2025-12-01 19:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e5bf890>
2025-12-01 19:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55b84b13-5059-5e90-832e-264f792c1794/55b84b13-5059-5e90-832e-264f792c1794_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDL65YEY%252F2025-12-01%252Fimage%252F6c93eda8-867e-465e-a360-30b445604ba3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL65YEY/2025-12-01/image/6c93eda8-867e-465e-a360-30b445604ba3_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55b84b13-5059-5e90-832e-264f792c1794
2025-12-01 19:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LX73WOH/2025-11-12/image/b6a7fa27-0937-4ff3-8d91-e4b2bb5130d4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117080670?view=catalogue)
2025-12-01 19:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD20HGY/2025-12-01/image/1fe48c30-f3fb-44bd-ae34-d894d8e15a2a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117622987?view=catalogue)
2025-12-01 19:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CT19GDV/2025-12-01/image/619608df-95c0-4ecf-b1d2-f83012bf3816_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623195?view=catalogue)
2025-12-01 19:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PK18ANU/2025-12-01/image/8db11a3b-e74d-4b44-8448-e50fdea3d811_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625254?view=catalogue)
2025-12-01 19:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8860decc-d092-5183-b3ca-b40ba3560e46 with identifier: 117638370
2025-12-01 19:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8860decc-d092-5183-b3ca-b40ba3560e46 with identifier: 117638370
2025-12-01 19:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 179937 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    179937
2025-12-01 19:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 8860decc-d092-5183-b3ca-b40ba3560e46 spider: astonbarclay.gb
2025-12-01 19:02:56 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 8860decc-d092-5183-b3ca-b40ba3560e46 due to rule: high_mileage_for_country.json, error: 179937 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    179937
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '8860decc-d092-5183-b3ca-b40ba3560e46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WM65NFL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117638370',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'S-MAX DIESEL ESTATE',
 'odometer': 111808,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8860decc-d092-5183-b3ca-b40ba3560e46/8860decc-d092-5183-b3ca-b40ba3560e46_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27107,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/b29ba2d9-5cb9-46fd-9600-0f8005abb06d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8860decc-d092-5183-b3ca-b40ba3560e46/8860decc-d092-5183-b3ca-b40ba3560e46_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28604,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/e0a74c21-41e5-4ee6-9d3a-c19a287d16bd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8860decc-d092-5183-b3ca-b40ba3560e46/8860decc-d092-5183-b3ca-b40ba3560e46_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32833,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/99baec5d-3d0f-4887-b275-75305120f659_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8860decc-d092-5183-b3ca-b40ba3560e46/8860decc-d092-5183-b3ca-b40ba3560e46_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29904,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/82bdc247-4e48-4f4f-b881-d2d364700ca5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8860decc-d092-5183-b3ca-b40ba3560e46/8860decc-d092-5183-b3ca-b40ba3560e46_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45976,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/90174c2c-176e-4233-9083-b49fc86221ae_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8860decc-d092-5183-b3ca-b40ba3560e46/8860decc-d092-5183-b3ca-b40ba3560e46_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42805,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/49e2ba5e-3361-4707-91a2-fd86aba16894_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8860decc-d092-5183-b3ca-b40ba3560e46/8860decc-d092-5183-b3ca-b40ba3560e46_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46090,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/cb1377ee-50e8-4c26-b3df-c625d437a5c7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8860decc-d092-5183-b3ca-b40ba3560e46/8860decc-d092-5183-b3ca-b40ba3560e46_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55586,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/4cd35509-48c9-402a-add6-77196dc6cfe1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8860decc-d092-5183-b3ca-b40ba3560e46/8860decc-d092-5183-b3ca-b40ba3560e46_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56589,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/faba0797-2bf4-434a-9bcc-9cb6ac36d761_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8860decc-d092-5183-b3ca-b40ba3560e46/8860decc-d092-5183-b3ca-b40ba3560e46_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40715,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM65NFL/2025-12-01/image/29f2f161-cc7f-494e-be66-5c5f7a1fdc3f_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-29',
 'seller_name': 'UKCGR',
 'title': 'FORD S-MAX DIESEL ESTATE 2.0 TDCi 180 Titanium 5dr Powershift',
 'transmission': 'automatic',
 'trim': '2.0 TDCi 180 Titanium 5dr Powershift',
 'vin': None,
 'year': 2016}
2025-12-01 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117638370%27 HTTP/1.1" 200 None
2025-12-01 19:02:56 [astonbarclay.gb] INFO: Saving data for 117638370: {'created_time': 1764615776.882185, 'last_price_update_time': 1764615776.882196}
2025-12-01 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117638370') HTTP/1.1" 204 0
2025-12-01 19:02:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e605810>
2025-12-01 19:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9a2d1f-5d0f-5846-b610-9c0e398774d5/3f9a2d1f-5d0f-5846-b610-9c0e398774d5_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPK18ANU%252F2025-12-01%252Fimage%252Fcb2957d0-de69-476f-978a-4bb05a04478c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK18ANU/2025-12-01/image/cb2957d0-de69-476f-978a-4bb05a04478c_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3f9a2d1f-5d0f-5846-b610-9c0e398774d5
2025-12-01 19:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e639790>
2025-12-01 19:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2820895d-4683-5acb-9ccf-a641b030a16e/2820895d-4683-5acb-9ccf-a641b030a16e_image_9.jpg HTTP/1.1" 201 0
2025-12-01 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKO17WEX%252F2025-12-01%252Fimage%252Fd42d7de0-9cb4-4c4e-a5a5-91cc07f29fe6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KO17WEX/2025-12-01/image/d42d7de0-9cb4-4c4e-a5a5-91cc07f29fe6_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2820895d-4683-5acb-9ccf-a641b030a16e
2025-12-01 19:02:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2820895d-4683-5acb-9ccf-a641b030a16e, skipping ID generation
2025-12-01 19:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2820895d-4683-5acb-9ccf-a641b030a16e with scrape type 1
2025-12-01 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2820895d-4683-5acb-9ccf-a641b030a16e from tracking dictionaries
2025-12-01 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2820895d-4683-5acb-9ccf-a641b030a16e sending to next pipeline
2025-12-01 19:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2820895d-4683-5acb-9ccf-a641b030a16e, identifier: 117628272
2025-12-01 19:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e777090>
2025-12-01 19:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba/ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD20HGY%252F2025-12-01%252Fimage%252F97c3c506-318a-47a0-9dea-ef3ecf231b9b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD20HGY/2025-12-01/image/97c3c506-318a-47a0-9dea-ef3ecf231b9b_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba
2025-12-01 19:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO18JKK/2025-12-01/image/27bdd94b-539b-43ec-8eb3-81352cde3a3c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117627785?view=catalogue)
2025-12-01 19:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SD20HGY/2025-12-01/image/af4932b7-fbfc-4ebf-b795-3509880f628d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117622987?view=catalogue)
2025-12-01 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPK18ANU%252F2025-12-01%252Fimage%252Fa75f8eaf-dabb-4ce5-908b-ed613f766818_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK18ANU/2025-12-01/image/a75f8eaf-dabb-4ce5-908b-ed613f766818_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDL65YEY%252F2025-12-01%252Fimage%252Fea3f5888-2e8c-47cf-acb3-6d8a4253729b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL65YEY/2025-12-01/image/ea3f5888-2e8c-47cf-acb3-6d8a4253729b_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO18JKK%252F2025-12-01%252Fimage%252F32cc8eb7-bec7-4cd4-9227-a31ae252f49c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO18JKK/2025-12-01/image/32cc8eb7-bec7-4cd4-9227-a31ae252f49c_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2820895d-4683-5acb-9ccf-a641b030a16e with identifier: 117628272
2025-12-01 19:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2820895d-4683-5acb-9ccf-a641b030a16e with identifier: 117628272
2025-12-01 19:02:57 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2820895d-4683-5acb-9ccf-a641b030a16e with identifier: 117628272 to the API
2025-12-01 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/KO17WEX/2025-12-01/image/d42d7de0-9cb4-4c4e-a5a5-91cc07f29fe6_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '2820895d-4683-5acb-9ccf-a641b030a16e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KO17WEX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117628272',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'C CLASS DIESEL SALOON',
 'odometer': 80650,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2820895d-4683-5acb-9ccf-a641b030a16e/2820895d-4683-5acb-9ccf-a641b030a16e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31192,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KO17WEX/2025-12-01/image/57212b9a-61b0-44f6-ae69-b9f36bab1ffa_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2820895d-4683-5acb-9ccf-a641b030a16e/2820895d-4683-5acb-9ccf-a641b030a16e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29550,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KO17WEX/2025-12-01/image/a1a4d14a-c81e-4bfe-ac48-3697e10b3b51_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2820895d-4683-5acb-9ccf-a641b030a16e/2820895d-4683-5acb-9ccf-a641b030a16e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30116,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KO17WEX/2025-12-01/image/add26511-0a91-4c36-8992-c04e8c513469_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2820895d-4683-5acb-9ccf-a641b030a16e/2820895d-4683-5acb-9ccf-a641b030a16e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27849,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KO17WEX/2025-12-01/image/0203db56-8a30-46fc-9caf-2a95c26fe46e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2820895d-4683-5acb-9ccf-a641b030a16e/2820895d-4683-5acb-9ccf-a641b030a16e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46374,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KO17WEX/2025-12-01/image/fd31edad-17a1-481b-a63f-aac851500c9b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2820895d-4683-5acb-9ccf-a641b030a16e/2820895d-4683-5acb-9ccf-a641b030a16e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50275,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KO17WEX/2025-12-01/image/096d985d-f0b7-4926-ac48-c194a9376cf6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2820895d-4683-5acb-9ccf-a641b030a16e/2820895d-4683-5acb-9ccf-a641b030a16e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50613,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KO17WEX/2025-12-01/image/049646db-5224-4a39-bdf0-4aee6d7ca1f5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2820895d-4683-5acb-9ccf-a641b030a16e/2820895d-4683-5acb-9ccf-a641b030a16e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49765,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KO17WEX/2025-12-01/image/4574be9c-18d7-43ae-be59-d6010e5e1beb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2820895d-4683-5acb-9ccf-a641b030a16e/2820895d-4683-5acb-9ccf-a641b030a16e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47351,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KO17WEX/2025-12-01/image/d87afa89-f04f-427a-b49c-2c003ea09013_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2820895d-4683-5acb-9ccf-a641b030a16e/2820895d-4683-5acb-9ccf-a641b030a16e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52096,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KO17WEX/2025-12-01/image/d42d7de0-9cb4-4c4e-a5a5-91cc07f29fe6_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-30',
 'seller_name': 'UKCGR',
 'title': 'MERCEDES-BENZ C CLASS DIESEL SALOON C250d AMG Line Premium Plus 4dr '
          '9G-Tronic',
 'transmission': 'automatic',
 'trim': 'C250d AMG Line Premium Plus 4dr 9G-Tronic',
 'vin': None,
 'year': 2017}
2025-12-01 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117628272%27 HTTP/1.1" 200 None
2025-12-01 19:02:58 [astonbarclay.gb] INFO: Saving data for 117628272: {'created_time': 1764615778.130388, 'last_price_update_time': 1764615778.130403}
2025-12-01 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117628272') HTTP/1.1" 204 0
2025-12-01 19:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e416890>
2025-12-01 19:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59764ae9-5e5a-5748-b4ed-bf9aea82270a/59764ae9-5e5a-5748-b4ed-bf9aea82270a_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCT19GDV%252F2025-12-01%252Fimage%252Fedb0841f-cd24-4e3c-aacb-2b6113cc462d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CT19GDV/2025-12-01/image/edb0841f-cd24-4e3c-aacb-2b6113cc462d_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 59764ae9-5e5a-5748-b4ed-bf9aea82270a
2025-12-01 19:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e783790>
2025-12-01 19:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d59180b-d1ec-5c2b-9f81-876a812e1c8f/9d59180b-d1ec-5c2b-9f81-876a812e1c8f_image_10.jpg HTTP/1.1" 201 0
2025-12-01 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX69UED%252F2025-12-01%252Fimage%252F5b910150-0143-46ba-8e53-2ca299f7768f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX69UED/2025-12-01/image/5b910150-0143-46ba-8e53-2ca299f7768f_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9d59180b-d1ec-5c2b-9f81-876a812e1c8f
2025-12-01 19:02:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d59180b-d1ec-5c2b-9f81-876a812e1c8f, skipping ID generation
2025-12-01 19:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d59180b-d1ec-5c2b-9f81-876a812e1c8f with scrape type 1
2025-12-01 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9d59180b-d1ec-5c2b-9f81-876a812e1c8f from tracking dictionaries
2025-12-01 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d59180b-d1ec-5c2b-9f81-876a812e1c8f sending to next pipeline
2025-12-01 19:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9d59180b-d1ec-5c2b-9f81-876a812e1c8f, identifier: 117629580
2025-12-01 19:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CT19GDV/2025-12-01/image/f4980e63-bb7e-4ab4-92a5-d151785a28f7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117623195?view=catalogue)
2025-12-01 19:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DL65YEY/2025-12-01/image/b8204fef-d2d0-467d-bb62-35c3d9021178_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625569?view=catalogue)
2025-12-01 19:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9d59180b-d1ec-5c2b-9f81-876a812e1c8f with identifier: 117629580
2025-12-01 19:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9d59180b-d1ec-5c2b-9f81-876a812e1c8f with identifier: 117629580
2025-12-01 19:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9d59180b-d1ec-5c2b-9f81-876a812e1c8f with identifier: 117629580 to the API
2025-12-01 19:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:02:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LX69UED/2025-12-01/image/5b910150-0143-46ba-8e53-2ca299f7768f_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '9d59180b-d1ec-5c2b-9f81-876a812e1c8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LX69UED',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117629580',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'QASHQAI DIESEL HATCHBACK',
 'odometer': 43853,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d59180b-d1ec-5c2b-9f81-876a812e1c8f/9d59180b-d1ec-5c2b-9f81-876a812e1c8f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28533,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/b91b8faf-e762-4aca-9526-c67ca8fee65c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d59180b-d1ec-5c2b-9f81-876a812e1c8f/9d59180b-d1ec-5c2b-9f81-876a812e1c8f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34376,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/976aeb19-50f5-4c27-8d21-ca7ec63a40ca_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d59180b-d1ec-5c2b-9f81-876a812e1c8f/9d59180b-d1ec-5c2b-9f81-876a812e1c8f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35484,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/3a8ff86f-9f4f-4bf1-8030-986b6364bee6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d59180b-d1ec-5c2b-9f81-876a812e1c8f/9d59180b-d1ec-5c2b-9f81-876a812e1c8f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34757,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/a3896bca-0380-40a4-8bce-fe581f28d386_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d59180b-d1ec-5c2b-9f81-876a812e1c8f/9d59180b-d1ec-5c2b-9f81-876a812e1c8f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43702,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/1094ac23-c88f-4b33-81a0-245b373faf84_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d59180b-d1ec-5c2b-9f81-876a812e1c8f/9d59180b-d1ec-5c2b-9f81-876a812e1c8f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38241,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/1949faf7-250a-4f3f-a743-ce03531ac39e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d59180b-d1ec-5c2b-9f81-876a812e1c8f/9d59180b-d1ec-5c2b-9f81-876a812e1c8f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51467,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/22848df7-7559-41c6-af64-ae33558efb1d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d59180b-d1ec-5c2b-9f81-876a812e1c8f/9d59180b-d1ec-5c2b-9f81-876a812e1c8f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41761,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/3060d354-32c1-43e1-a34f-327d14864a9f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d59180b-d1ec-5c2b-9f81-876a812e1c8f/9d59180b-d1ec-5c2b-9f81-876a812e1c8f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38923,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/a82b318a-d426-4d88-bf0e-d0cea6434722_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d59180b-d1ec-5c2b-9f81-876a812e1c8f/9d59180b-d1ec-5c2b-9f81-876a812e1c8f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48471,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/4f05a703-eb66-4353-8185-cbd14f32f981_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d59180b-d1ec-5c2b-9f81-876a812e1c8f/9d59180b-d1ec-5c2b-9f81-876a812e1c8f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72842,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/LX69UED/2025-12-01/image/5b910150-0143-46ba-8e53-2ca299f7768f_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-21',
 'seller_name': 'UKCGR',
 'title': 'NISSAN QASHQAI DIESEL HATCHBACK 1.5 dCi 115 Acenta Premium 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.5 dCi 115 Acenta Premium 5dr DCT',
 'vin': None,
 'year': 2019}
2025-12-01 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117629580%27 HTTP/1.1" 200 None
2025-12-01 19:02:59 [astonbarclay.gb] INFO: Saving data for 117629580: {'created_time': 1764615779.214486, 'last_price_update_time': 1764615779.214495}
2025-12-01 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117629580') HTTP/1.1" 204 0
2025-12-01 19:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e862190>
2025-12-01 19:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96670254-9e60-53c1-a1c3-3ccb32ebbceb/96670254-9e60-53c1-a1c3-3ccb32ebbceb_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAU23OBX%252F2025-12-01%252Fimage%252Fa7e4ea61-c38b-46fc-a4e4-e94d5232e13b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AU23OBX/2025-12-01/image/a7e4ea61-c38b-46fc-a4e4-e94d5232e13b_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 96670254-9e60-53c1-a1c3-3ccb32ebbceb
2025-12-01 19:02:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96670254-9e60-53c1-a1c3-3ccb32ebbceb, skipping ID generation
2025-12-01 19:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96670254-9e60-53c1-a1c3-3ccb32ebbceb with scrape type 1
2025-12-01 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 96670254-9e60-53c1-a1c3-3ccb32ebbceb from tracking dictionaries
2025-12-01 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96670254-9e60-53c1-a1c3-3ccb32ebbceb sending to next pipeline
2025-12-01 19:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 96670254-9e60-53c1-a1c3-3ccb32ebbceb, identifier: 117634646
2025-12-01 19:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e90f050>
2025-12-01 19:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55b84b13-5059-5e90-832e-264f792c1794/55b84b13-5059-5e90-832e-264f792c1794_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDL65YEY%252F2025-12-01%252Fimage%252Fc69af0e2-4c36-4494-8bae-9b0792d89f9d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL65YEY/2025-12-01/image/c69af0e2-4c36-4494-8bae-9b0792d89f9d_removebg.jpg?w=600 saved to cache
2025-12-01 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55b84b13-5059-5e90-832e-264f792c1794
2025-12-01 19:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PK18ANU/2025-12-01/image/12fe1d66-65e9-4e58-a7f9-1575c7715089_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625254?view=catalogue)
2025-12-01 19:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DL65YEY/2025-12-01/image/86d3aec2-736c-4c54-8c9e-435a5f6a2a3e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625569?view=catalogue)
2025-12-01 19:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO18JKK/2025-12-01/image/3c4691bd-fb61-462a-9086-21c16a0b53d6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117627785?view=catalogue)
2025-12-01 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPK18ANU%252F2025-12-01%252Fimage%252F781c893c-f9ad-4553-981e-0dcae7733f70_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK18ANU/2025-12-01/image/781c893c-f9ad-4553-981e-0dcae7733f70_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO18JKK%252F2025-12-01%252Fimage%252Fb43f7eb7-bd59-43c4-932b-7aad6701dfd8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO18JKK/2025-12-01/image/b43f7eb7-bd59-43c4-932b-7aad6701dfd8_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 96670254-9e60-53c1-a1c3-3ccb32ebbceb with identifier: 117634646
2025-12-01 19:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 96670254-9e60-53c1-a1c3-3ccb32ebbceb with identifier: 117634646
2025-12-01 19:02:59 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 96670254-9e60-53c1-a1c3-3ccb32ebbceb with identifier: 117634646 to the API
2025-12-01 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/AU23OBX/2025-12-01/image/a7e4ea61-c38b-46fc-a4e4-e94d5232e13b_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '96670254-9e60-53c1-a1c3-3ccb32ebbceb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AU23OBX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117634646',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN DIESEL ESTATE',
 'odometer': 12718,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96670254-9e60-53c1-a1c3-3ccb32ebbceb/96670254-9e60-53c1-a1c3-3ccb32ebbceb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37832,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AU23OBX/2025-12-01/image/d13dfe4b-d596-4d85-ab3d-ca2cfcbb8bd1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96670254-9e60-53c1-a1c3-3ccb32ebbceb/96670254-9e60-53c1-a1c3-3ccb32ebbceb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35350,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AU23OBX/2025-12-01/image/0d70a26e-25c5-4f48-808a-1932c6706733_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96670254-9e60-53c1-a1c3-3ccb32ebbceb/96670254-9e60-53c1-a1c3-3ccb32ebbceb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36303,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AU23OBX/2025-12-01/image/bc5a24ec-9b6a-439f-b251-b18e313c797b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96670254-9e60-53c1-a1c3-3ccb32ebbceb/96670254-9e60-53c1-a1c3-3ccb32ebbceb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38168,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AU23OBX/2025-12-01/image/9816596c-c6d7-43d2-a414-884363cca987_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96670254-9e60-53c1-a1c3-3ccb32ebbceb/96670254-9e60-53c1-a1c3-3ccb32ebbceb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46448,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AU23OBX/2025-12-01/image/0bbd359b-abd7-4cbc-96cf-54aea143b526_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96670254-9e60-53c1-a1c3-3ccb32ebbceb/96670254-9e60-53c1-a1c3-3ccb32ebbceb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47549,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AU23OBX/2025-12-01/image/c020cfae-1ff5-4027-8cfc-e8fdc367e285_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96670254-9e60-53c1-a1c3-3ccb32ebbceb/96670254-9e60-53c1-a1c3-3ccb32ebbceb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37909,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AU23OBX/2025-12-01/image/19f364bb-be75-4107-877a-6da8ff652d72_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96670254-9e60-53c1-a1c3-3ccb32ebbceb/96670254-9e60-53c1-a1c3-3ccb32ebbceb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42280,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AU23OBX/2025-12-01/image/e5af90f2-e33e-4c3c-97ee-a6e10ff0e030_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96670254-9e60-53c1-a1c3-3ccb32ebbceb/96670254-9e60-53c1-a1c3-3ccb32ebbceb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39756,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AU23OBX/2025-12-01/image/a7e4ea61-c38b-46fc-a4e4-e94d5232e13b_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-18',
 'seller_name': 'UKCGR',
 'title': 'VOLKSWAGEN TIGUAN DIESEL ESTATE 2.0 TDI R-Line 5dr DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDI R-Line 5dr DSG',
 'vin': None,
 'year': 2023}
2025-12-01 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117634646%27 HTTP/1.1" 200 None
2025-12-01 19:03:00 [astonbarclay.gb] INFO: Saving data for 117634646: {'created_time': 1764615780.242824, 'last_price_update_time': 1764615780.242835}
2025-12-01 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117634646') HTTP/1.1" 204 0
2025-12-01 19:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e84e8d0>
2025-12-01 19:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1a8361b-a960-5c0c-86a5-26eec748d1ec/a1a8361b-a960-5c0c-86a5-26eec748d1ec_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLX73WOH%252F2025-11-12%252Fimage%252Fb6a7fa27-0937-4ff3-8d91-e4b2bb5130d4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LX73WOH/2025-11-12/image/b6a7fa27-0937-4ff3-8d91-e4b2bb5130d4_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1a8361b-a960-5c0c-86a5-26eec748d1ec
2025-12-01 19:03:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1a8361b-a960-5c0c-86a5-26eec748d1ec, skipping ID generation
2025-12-01 19:03:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1a8361b-a960-5c0c-86a5-26eec748d1ec with scrape type 1
2025-12-01 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a1a8361b-a960-5c0c-86a5-26eec748d1ec from tracking dictionaries
2025-12-01 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1a8361b-a960-5c0c-86a5-26eec748d1ec sending to next pipeline
2025-12-01 19:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a1a8361b-a960-5c0c-86a5-26eec748d1ec, identifier: 117080670
2025-12-01 19:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e68e790>
2025-12-01 19:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba/ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD20HGY%252F2025-12-01%252Fimage%252F1fe48c30-f3fb-44bd-ae34-d894d8e15a2a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD20HGY/2025-12-01/image/1fe48c30-f3fb-44bd-ae34-d894d8e15a2a_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba
2025-12-01 19:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f2db850>
2025-12-01 19:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59764ae9-5e5a-5748-b4ed-bf9aea82270a/59764ae9-5e5a-5748-b4ed-bf9aea82270a_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCT19GDV%252F2025-12-01%252Fimage%252F619608df-95c0-4ecf-b1d2-f83012bf3816_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CT19GDV/2025-12-01/image/619608df-95c0-4ecf-b1d2-f83012bf3816_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 59764ae9-5e5a-5748-b4ed-bf9aea82270a
2025-12-01 19:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e85a310>
2025-12-01 19:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9a2d1f-5d0f-5846-b610-9c0e398774d5/3f9a2d1f-5d0f-5846-b610-9c0e398774d5_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPK18ANU%252F2025-12-01%252Fimage%252F8db11a3b-e74d-4b44-8448-e50fdea3d811_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK18ANU/2025-12-01/image/8db11a3b-e74d-4b44-8448-e50fdea3d811_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3f9a2d1f-5d0f-5846-b610-9c0e398774d5
2025-12-01 19:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO18JKK/2025-12-01/image/268e3f56-ac14-49f2-8157-af1c1f3fb1b2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117627785?view=catalogue)
2025-12-01 19:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DL65YEY/2025-12-01/image/efcded0f-9045-4fcd-b148-1c4daa8f761a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625569?view=catalogue)
2025-12-01 19:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PK18ANU/2025-12-01/image/fd8bd7f3-e8a5-4517-9f61-7516fc265415_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625254?view=catalogue)
2025-12-01 19:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a1a8361b-a960-5c0c-86a5-26eec748d1ec with identifier: 117080670
2025-12-01 19:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a1a8361b-a960-5c0c-86a5-26eec748d1ec with identifier: 117080670
2025-12-01 19:03:01 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a1a8361b-a960-5c0c-86a5-26eec748d1ec with identifier: 117080670 to the API
2025-12-01 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:03:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LX73WOH/2025-11-12/image/b6a7fa27-0937-4ff3-8d91-e4b2bb5130d4_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a1a8361b-a960-5c0c-86a5-26eec748d1ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LX73WOH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117080670',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'POLO HATCHBACK',
 'odometer': 24778,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1a8361b-a960-5c0c-86a5-26eec748d1ec/a1a8361b-a960-5c0c-86a5-26eec748d1ec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32076,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/b6a7fa27-0937-4ff3-8d91-e4b2bb5130d4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1a8361b-a960-5c0c-86a5-26eec748d1ec/a1a8361b-a960-5c0c-86a5-26eec748d1ec_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30901,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/6be52a8c-6c4e-4b01-baf7-ffe57b26864f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1a8361b-a960-5c0c-86a5-26eec748d1ec/a1a8361b-a960-5c0c-86a5-26eec748d1ec_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29569,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/776351df-9ca4-451e-b0c9-d49c1a035615_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1a8361b-a960-5c0c-86a5-26eec748d1ec/a1a8361b-a960-5c0c-86a5-26eec748d1ec_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31846,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/297cf991-9b8e-4ec8-855d-da5f4de84bfb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1a8361b-a960-5c0c-86a5-26eec748d1ec/a1a8361b-a960-5c0c-86a5-26eec748d1ec_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44924,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/a2788cd7-85ad-4861-b146-c6dd9637c0ae_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1a8361b-a960-5c0c-86a5-26eec748d1ec/a1a8361b-a960-5c0c-86a5-26eec748d1ec_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48722,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/1aa2008d-b6f7-4728-a5aa-2bac1d7a31a7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1a8361b-a960-5c0c-86a5-26eec748d1ec/a1a8361b-a960-5c0c-86a5-26eec748d1ec_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50632,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/1cf49a13-1c13-45ef-b1ce-5a8a7c1a5708_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1a8361b-a960-5c0c-86a5-26eec748d1ec/a1a8361b-a960-5c0c-86a5-26eec748d1ec_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57025,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/eb300b4c-adb3-4a28-a652-603e10241439_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1a8361b-a960-5c0c-86a5-26eec748d1ec/a1a8361b-a960-5c0c-86a5-26eec748d1ec_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49338,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/c4a878bd-782c-42f0-91ba-2574458510a0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1a8361b-a960-5c0c-86a5-26eec748d1ec/a1a8361b-a960-5c0c-86a5-26eec748d1ec_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56533,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LX73WOH/2025-11-12/image/eb864b5a-6a54-4e10-a564-f6303ceacd1a_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-22',
 'seller_name': 'Motability Operations',
 'title': 'VOLKSWAGEN POLO HATCHBACK 1.0 TSI R-Line 5dr',
 'transmission': 'manual',
 'trim': '1.0 TSI R-Line 5dr',
 'vin': None,
 'year': 2023}
2025-12-01 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117080670%27 HTTP/1.1" 200 None
2025-12-01 19:03:01 [astonbarclay.gb] INFO: Saving data for 117080670: {'created_time': 1764615781.644514, 'last_price_update_time': 1764615781.644526, 'auction_closing_time': 1765792800.0}
2025-12-01 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117080670') HTTP/1.1" 204 0
2025-12-01 19:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e9a9a50>
2025-12-01 19:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b82772-9067-5549-932e-76f41c49ba19/28b82772-9067-5549-932e-76f41c49ba19_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO18JKK%252F2025-12-01%252Fimage%252F27bdd94b-539b-43ec-8eb3-81352cde3a3c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO18JKK/2025-12-01/image/27bdd94b-539b-43ec-8eb3-81352cde3a3c_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 28b82772-9067-5549-932e-76f41c49ba19
2025-12-01 19:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e7930d0>
2025-12-01 19:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba/ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSD20HGY%252F2025-12-01%252Fimage%252Faf4932b7-fbfc-4ebf-b795-3509880f628d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SD20HGY/2025-12-01/image/af4932b7-fbfc-4ebf-b795-3509880f628d_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba
2025-12-01 19:03:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba, skipping ID generation
2025-12-01 19:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba with scrape type 1
2025-12-01 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba from tracking dictionaries
2025-12-01 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba sending to next pipeline
2025-12-01 19:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba, identifier: 117622987
2025-12-01 19:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PK18ANU/2025-12-01/image/f7c371da-7154-457a-89df-bc46f97ade8a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625254?view=catalogue)
2025-12-01 19:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YS65KSU/2025-10-22/image/81c6137c-c0e4-48f6-81b4-438c970c7729_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/60238390?view=catalogue)
2025-12-01 19:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/328bf1f9-5cfb-446e-b07d-5962f453a871.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117610728?view=catalogue)
2025-12-01 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO18JKK%252F2025-12-01%252Fimage%252F874341f9-f211-491b-87ca-e9698be01f8e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO18JKK/2025-12-01/image/874341f9-f211-491b-87ca-e9698be01f8e_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba with identifier: 117622987
2025-12-01 19:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba with identifier: 117622987
2025-12-01 19:03:02 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba with identifier: 117622987 to the API
2025-12-01 19:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:03:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/SD20HGY/2025-12-01/image/af4932b7-fbfc-4ebf-b795-3509880f628d_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SD20HGY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117622987',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'Q2 ESTATE',
 'odometer': 39555,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba/ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30937,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SD20HGY/2025-12-01/image/4362a4ee-f363-4bc1-b26b-f1e313668e52_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba/ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29055,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SD20HGY/2025-12-01/image/b92be8cd-5cc5-4eb3-a8a9-f14ca1587f2d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba/ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33978,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SD20HGY/2025-12-01/image/2bd50cf9-cd59-4b53-9074-21b1e65b944d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba/ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32360,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SD20HGY/2025-12-01/image/6b8a0c4d-ce04-4e3d-934a-975232d3a771_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba/ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43895,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SD20HGY/2025-12-01/image/e153a2c1-dfb2-4b01-815d-f20798392446_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba/ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43947,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SD20HGY/2025-12-01/image/d8ad4aa4-41a9-4151-9148-8e85e2a81ca4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba/ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45445,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SD20HGY/2025-12-01/image/97c3c506-318a-47a0-9dea-ef3ecf231b9b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba/ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37197,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SD20HGY/2025-12-01/image/1fe48c30-f3fb-44bd-ae34-d894d8e15a2a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba/ad5ddb1b-9282-514b-9cc7-ae8a5d98d8ba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50903,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SD20HGY/2025-12-01/image/af4932b7-fbfc-4ebf-b795-3509880f628d_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-06',
 'seller_name': 'UKCGR',
 'title': 'AUDI Q2 ESTATE 30 TFSI Black Edition 5dr',
 'transmission': 'manual',
 'trim': '30 TFSI Black Edition 5dr',
 'vin': None,
 'year': 2020}
2025-12-01 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117622987%27 HTTP/1.1" 200 None
2025-12-01 19:03:02 [astonbarclay.gb] INFO: Saving data for 117622987: {'created_time': 1764615782.61675, 'last_price_update_time': 1764615782.616761}
2025-12-01 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117622987') HTTP/1.1" 204 0
2025-12-01 19:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e862c90>
2025-12-01 19:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59764ae9-5e5a-5748-b4ed-bf9aea82270a/59764ae9-5e5a-5748-b4ed-bf9aea82270a_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCT19GDV%252F2025-12-01%252Fimage%252Ff4980e63-bb7e-4ab4-92a5-d151785a28f7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CT19GDV/2025-12-01/image/f4980e63-bb7e-4ab4-92a5-d151785a28f7_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 59764ae9-5e5a-5748-b4ed-bf9aea82270a
2025-12-01 19:03:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 59764ae9-5e5a-5748-b4ed-bf9aea82270a, skipping ID generation
2025-12-01 19:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59764ae9-5e5a-5748-b4ed-bf9aea82270a with scrape type 1
2025-12-01 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 59764ae9-5e5a-5748-b4ed-bf9aea82270a from tracking dictionaries
2025-12-01 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 59764ae9-5e5a-5748-b4ed-bf9aea82270a sending to next pipeline
2025-12-01 19:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 59764ae9-5e5a-5748-b4ed-bf9aea82270a, identifier: 117623195
2025-12-01 19:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6300d0>
2025-12-01 19:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55b84b13-5059-5e90-832e-264f792c1794/55b84b13-5059-5e90-832e-264f792c1794_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDL65YEY%252F2025-12-01%252Fimage%252Fb8204fef-d2d0-467d-bb62-35c3d9021178_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL65YEY/2025-12-01/image/b8204fef-d2d0-467d-bb62-35c3d9021178_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55b84b13-5059-5e90-832e-264f792c1794
2025-12-01 19:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PK18ANU/2025-12-01/image/4f7deb18-1649-472f-9cf3-3497394c3c9c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625254?view=catalogue)
2025-12-01 19:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DL65YEY/2025-12-01/image/c632fbac-3073-48ee-8bf1-82b49a0527b2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625569?view=catalogue)
2025-12-01 19:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO18JKK/2025-12-01/image/36deaa9e-ee8a-4a96-b565-1114285a10ec_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117627785?view=catalogue)
2025-12-01 19:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 59764ae9-5e5a-5748-b4ed-bf9aea82270a with identifier: 117623195
2025-12-01 19:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 59764ae9-5e5a-5748-b4ed-bf9aea82270a with identifier: 117623195
2025-12-01 19:03:03 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 59764ae9-5e5a-5748-b4ed-bf9aea82270a with identifier: 117623195 to the API
2025-12-01 19:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/CT19GDV/2025-12-01/image/f4980e63-bb7e-4ab4-92a5-d151785a28f7_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '59764ae9-5e5a-5748-b4ed-bf9aea82270a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'CT19GDV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117623195',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'SEAT',
 'model': 'MII HATCHBACK',
 'odometer': 37447,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59764ae9-5e5a-5748-b4ed-bf9aea82270a/59764ae9-5e5a-5748-b4ed-bf9aea82270a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34544,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CT19GDV/2025-12-01/image/d8543f5d-d344-4306-b3cc-b982621bf191_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59764ae9-5e5a-5748-b4ed-bf9aea82270a/59764ae9-5e5a-5748-b4ed-bf9aea82270a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39673,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CT19GDV/2025-12-01/image/f5ca84ab-0d04-44a5-81e3-af851f931e89_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59764ae9-5e5a-5748-b4ed-bf9aea82270a/59764ae9-5e5a-5748-b4ed-bf9aea82270a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32755,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CT19GDV/2025-12-01/image/182b8f7b-9db3-4c36-ad59-07f3851f07ef_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59764ae9-5e5a-5748-b4ed-bf9aea82270a/59764ae9-5e5a-5748-b4ed-bf9aea82270a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34338,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CT19GDV/2025-12-01/image/0b214c68-7983-4e33-883a-a1685fd57f15_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59764ae9-5e5a-5748-b4ed-bf9aea82270a/59764ae9-5e5a-5748-b4ed-bf9aea82270a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52431,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CT19GDV/2025-12-01/image/b08bdcc8-f2c8-4bf8-a9b7-3d0a115079fc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59764ae9-5e5a-5748-b4ed-bf9aea82270a/59764ae9-5e5a-5748-b4ed-bf9aea82270a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51662,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CT19GDV/2025-12-01/image/53a278b7-eb92-42b1-9130-537dc5be2863_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59764ae9-5e5a-5748-b4ed-bf9aea82270a/59764ae9-5e5a-5748-b4ed-bf9aea82270a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44591,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CT19GDV/2025-12-01/image/edb0841f-cd24-4e3c-aacb-2b6113cc462d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59764ae9-5e5a-5748-b4ed-bf9aea82270a/59764ae9-5e5a-5748-b4ed-bf9aea82270a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51949,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CT19GDV/2025-12-01/image/619608df-95c0-4ecf-b1d2-f83012bf3816_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59764ae9-5e5a-5748-b4ed-bf9aea82270a/59764ae9-5e5a-5748-b4ed-bf9aea82270a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44286,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CT19GDV/2025-12-01/image/f4980e63-bb7e-4ab4-92a5-d151785a28f7_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-30',
 'seller_name': 'UKCGR',
 'title': 'SEAT MII HATCHBACK 1.0 Design Mii [EZ] 5dr',
 'transmission': 'manual',
 'trim': '1.0 Design Mii [EZ] 5dr',
 'vin': None,
 'year': 2019}
2025-12-01 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117623195%27 HTTP/1.1" 200 None
2025-12-01 19:03:03 [astonbarclay.gb] INFO: Saving data for 117623195: {'created_time': 1764615783.618849, 'last_price_update_time': 1764615783.618859}
2025-12-01 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117623195') HTTP/1.1" 204 0
2025-12-01 19:03:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6c3810>
2025-12-01 19:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9a2d1f-5d0f-5846-b610-9c0e398774d5/3f9a2d1f-5d0f-5846-b610-9c0e398774d5_image_9.jpg HTTP/1.1" 201 0
2025-12-01 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPK18ANU%252F2025-12-01%252Fimage%252F12fe1d66-65e9-4e58-a7f9-1575c7715089_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK18ANU/2025-12-01/image/12fe1d66-65e9-4e58-a7f9-1575c7715089_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3f9a2d1f-5d0f-5846-b610-9c0e398774d5
2025-12-01 19:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e68d610>
2025-12-01 19:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55b84b13-5059-5e90-832e-264f792c1794/55b84b13-5059-5e90-832e-264f792c1794_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDL65YEY%252F2025-12-01%252Fimage%252F86d3aec2-736c-4c54-8c9e-435a5f6a2a3e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL65YEY/2025-12-01/image/86d3aec2-736c-4c54-8c9e-435a5f6a2a3e_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 55b84b13-5059-5e90-832e-264f792c1794
2025-12-01 19:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6222d0>
2025-12-01 19:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b82772-9067-5549-932e-76f41c49ba19/28b82772-9067-5549-932e-76f41c49ba19_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO18JKK%252F2025-12-01%252Fimage%252F3c4691bd-fb61-462a-9086-21c16a0b53d6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO18JKK/2025-12-01/image/3c4691bd-fb61-462a-9086-21c16a0b53d6_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 28b82772-9067-5549-932e-76f41c49ba19
2025-12-01 19:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WM74SKU/2025-12-01/image/c9ae33f4-eb6f-46f9-b3dc-22283d870fc2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117631028?view=catalogue)
2025-12-01 19:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DL65YEY/2025-12-01/image/ea3f5888-2e8c-47cf-acb3-6d8a4253729b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625569?view=catalogue)
2025-12-01 19:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO18JKK/2025-12-01/image/32cc8eb7-bec7-4cd4-9227-a31ae252f49c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117627785?view=catalogue)
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEO18JKK%252F2025-12-01%252Fimage%252F3f5ead84-988d-41cf-8cf5-0a15dfd879f5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO18JKK/2025-12-01/image/3f5ead84-988d-41cf-8cf5-0a15dfd879f5_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117395964?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e5db710>
2025-12-01 19:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b82772-9067-5549-932e-76f41c49ba19/28b82772-9067-5549-932e-76f41c49ba19_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO18JKK%252F2025-12-01%252Fimage%252F268e3f56-ac14-49f2-8157-af1c1f3fb1b2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO18JKK/2025-12-01/image/268e3f56-ac14-49f2-8157-af1c1f3fb1b2_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 28b82772-9067-5549-932e-76f41c49ba19
2025-12-01 19:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e999450>
2025-12-01 19:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55b84b13-5059-5e90-832e-264f792c1794/55b84b13-5059-5e90-832e-264f792c1794_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDL65YEY%252F2025-12-01%252Fimage%252Fefcded0f-9045-4fcd-b148-1c4daa8f761a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL65YEY/2025-12-01/image/efcded0f-9045-4fcd-b148-1c4daa8f761a_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 55b84b13-5059-5e90-832e-264f792c1794
2025-12-01 19:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e5d9a50>
2025-12-01 19:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9a2d1f-5d0f-5846-b610-9c0e398774d5/3f9a2d1f-5d0f-5846-b610-9c0e398774d5_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPK18ANU%252F2025-12-01%252Fimage%252Ffd8bd7f3-e8a5-4517-9f61-7516fc265415_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK18ANU/2025-12-01/image/fd8bd7f3-e8a5-4517-9f61-7516fc265415_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3f9a2d1f-5d0f-5846-b610-9c0e398774d5
2025-12-01 19:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PK18ANU/2025-12-01/image/a75f8eaf-dabb-4ce5-908b-ed613f766818_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625254?view=catalogue)
2025-12-01 19:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AGZ6324/2025-11-20/image/51b98e9a-1ced-4cce-8c82-14bd500e0a3c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117366549?view=catalogue)
2025-12-01 19:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117394487?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e54c910>
2025-12-01 19:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-01 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9a2d1f-5d0f-5846-b610-9c0e398774d5/3f9a2d1f-5d0f-5846-b610-9c0e398774d5_image_10.jpg HTTP/1.1" 201 0
2025-12-01 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPK18ANU%252F2025-12-01%252Fimage%252Ff7c371da-7154-457a-89df-bc46f97ade8a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK18ANU/2025-12-01/image/f7c371da-7154-457a-89df-bc46f97ade8a_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3f9a2d1f-5d0f-5846-b610-9c0e398774d5
2025-12-01 19:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e8752d0>
2025-12-01 19:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ec9234c-0d71-5d07-b7f0-d851996db0b8/8ec9234c-0d71-5d07-b7f0-d851996db0b8_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYS65KSU%252F2025-10-22%252Fimage%252F81c6137c-c0e4-48f6-81b4-438c970c7729_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YS65KSU/2025-10-22/image/81c6137c-c0e4-48f6-81b4-438c970c7729_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8ec9234c-0d71-5d07-b7f0-d851996db0b8
2025-12-01 19:03:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ec9234c-0d71-5d07-b7f0-d851996db0b8, skipping ID generation
2025-12-01 19:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ec9234c-0d71-5d07-b7f0-d851996db0b8 with scrape type 1
2025-12-01 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8ec9234c-0d71-5d07-b7f0-d851996db0b8 from tracking dictionaries
2025-12-01 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ec9234c-0d71-5d07-b7f0-d851996db0b8 sending to next pipeline
2025-12-01 19:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8ec9234c-0d71-5d07-b7f0-d851996db0b8, identifier: 60238390
2025-12-01 19:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e7b9910>
2025-12-01 19:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4471d1-1330-5f18-bc6b-f50165d7cebc/9b4471d1-1330-5f18-bc6b-f50165d7cebc_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F328bf1f9-5cfb-446e-b07d-5962f453a871.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/328bf1f9-5cfb-446e-b07d-5962f453a871.jpg?w=600 saved to cache
2025-12-01 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b4471d1-1330-5f18-bc6b-f50165d7cebc
2025-12-01 19:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PK18ANU/2025-12-01/image/781c893c-f9ad-4553-981e-0dcae7733f70_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117625254?view=catalogue)
2025-12-01 19:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO18JKK/2025-12-01/image/b43f7eb7-bd59-43c4-932b-7aad6701dfd8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117627785?view=catalogue)
2025-12-01 19:03:06 [scrapy.extensions.logstats] INFO: Crawled 102 pages (at 16 pages/min), scraped 55 items (at 19 items/min)
2025-12-01 19:03:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8ec9234c-0d71-5d07-b7f0-d851996db0b8 with identifier: 60238390
2025-12-01 19:03:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8ec9234c-0d71-5d07-b7f0-d851996db0b8 with identifier: 60238390
2025-12-01 19:03:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-01 19:03:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 8ec9234c-0d71-5d07-b7f0-d851996db0b8 spider: astonbarclay.gb
2025-12-01 19:03:06 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 8ec9234c-0d71-5d07-b7f0-d851996db0b8 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': None,
 'engine': '1.4L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '8ec9234c-0d71-5d07-b7f0-d851996db0b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YS65KSU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/60238390',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VAUXHALL',
 'model': 'MOKKA HATCHBACK',
 'odometer': 74810,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ec9234c-0d71-5d07-b7f0-d851996db0b8/8ec9234c-0d71-5d07-b7f0-d851996db0b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30393,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/41536d8d-3ae9-4a72-ae0b-02c1bce75441_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ec9234c-0d71-5d07-b7f0-d851996db0b8/8ec9234c-0d71-5d07-b7f0-d851996db0b8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30272,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/66a94ce6-a780-4ea9-af23-346569b3c186_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ec9234c-0d71-5d07-b7f0-d851996db0b8/8ec9234c-0d71-5d07-b7f0-d851996db0b8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25088,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/e89c3920-3b2e-4169-aae8-b61d86f81059_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ec9234c-0d71-5d07-b7f0-d851996db0b8/8ec9234c-0d71-5d07-b7f0-d851996db0b8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25757,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/7d6aa15b-22ac-4b3f-9732-fd4b26aea4a5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ec9234c-0d71-5d07-b7f0-d851996db0b8/8ec9234c-0d71-5d07-b7f0-d851996db0b8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59487,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/81c6137c-c0e4-48f6-81b4-438c970c7729_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ec9234c-0d71-5d07-b7f0-d851996db0b8/8ec9234c-0d71-5d07-b7f0-d851996db0b8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59775,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/702e4ba9-c8c1-4785-8219-825aa82a60b1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ec9234c-0d71-5d07-b7f0-d851996db0b8/8ec9234c-0d71-5d07-b7f0-d851996db0b8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35018,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/36bdecec-d520-4b0c-93a0-29f204ad4f61_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ec9234c-0d71-5d07-b7f0-d851996db0b8/8ec9234c-0d71-5d07-b7f0-d851996db0b8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38156,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/f4608216-bca5-402e-9195-8aa0fec2b3d5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ec9234c-0d71-5d07-b7f0-d851996db0b8/8ec9234c-0d71-5d07-b7f0-d851996db0b8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49187,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YS65KSU/2025-10-22/image/395bda17-874f-40d3-a2c2-ca09cce26ae3_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-22',
 'seller_name': 'Zuto',
 'title': 'VAUXHALL MOKKA HATCHBACK 1.4T SE 5dr',
 'transmission': 'manual',
 'trim': '1.4T SE 5dr',
 'vin': None,
 'year': 2015}
2025-12-01 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2760238390%27 HTTP/1.1" 200 None
2025-12-01 19:03:06 [astonbarclay.gb] INFO: Saving data for 60238390: {'created_time': 1764615786.393605, 'last_price_update_time': 1764615786.393615, 'auction_closing_time': 1765285200.0}
2025-12-01 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='60238390') HTTP/1.1" 204 0
2025-12-01 19:03:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:03:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f25e750>
2025-12-01 19:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9a2d1f-5d0f-5846-b610-9c0e398774d5/3f9a2d1f-5d0f-5846-b610-9c0e398774d5_image_11.jpg HTTP/1.1" 201 0
2025-12-01 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPK18ANU%252F2025-12-01%252Fimage%252F4f7deb18-1649-472f-9cf3-3497394c3c9c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK18ANU/2025-12-01/image/4f7deb18-1649-472f-9cf3-3497394c3c9c_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3f9a2d1f-5d0f-5846-b610-9c0e398774d5
2025-12-01 19:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e578610>
2025-12-01 19:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-01 19:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55b84b13-5059-5e90-832e-264f792c1794/55b84b13-5059-5e90-832e-264f792c1794_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDL65YEY%252F2025-12-01%252Fimage%252Fc632fbac-3073-48ee-8bf1-82b49a0527b2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL65YEY/2025-12-01/image/c632fbac-3073-48ee-8bf1-82b49a0527b2_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 55b84b13-5059-5e90-832e-264f792c1794
2025-12-01 19:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e57be10>
2025-12-01 19:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-01 19:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b82772-9067-5549-932e-76f41c49ba19/28b82772-9067-5549-932e-76f41c49ba19_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO18JKK%252F2025-12-01%252Fimage%252F36deaa9e-ee8a-4a96-b565-1114285a10ec_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO18JKK/2025-12-01/image/36deaa9e-ee8a-4a96-b565-1114285a10ec_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 28b82772-9067-5549-932e-76f41c49ba19
2025-12-01 19:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AGZ6324/2025-11-20/image/38c76a2d-bd26-4a20-ae91-47ad52873139_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117366549?view=catalogue)
2025-12-01 19:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/e68f76e3-5134-4041-abe5-4fef8c59ae05.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117610728?view=catalogue)
2025-12-01 19:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/299edf6b-fd89-4b09-bc7b-cbbca3dae92f.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117610728?view=catalogue)
2025-12-01 19:03:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f2c0f50>
2025-12-01 19:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWM74SKU%252F2025-12-01%252Fimage%252Fc9ae33f4-eb6f-46f9-b3dc-22283d870fc2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WM74SKU/2025-12-01/image/c9ae33f4-eb6f-46f9-b3dc-22283d870fc2_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a7fd25af-1c0c-5745-a7fa-634525bcac68
2025-12-01 19:03:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7fd25af-1c0c-5745-a7fa-634525bcac68, skipping ID generation
2025-12-01 19:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7fd25af-1c0c-5745-a7fa-634525bcac68 with scrape type 1
2025-12-01 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a7fd25af-1c0c-5745-a7fa-634525bcac68 from tracking dictionaries
2025-12-01 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7fd25af-1c0c-5745-a7fa-634525bcac68 sending to next pipeline
2025-12-01 19:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a7fd25af-1c0c-5745-a7fa-634525bcac68, identifier: 117631028
2025-12-01 19:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f284310>
2025-12-01 19:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55b84b13-5059-5e90-832e-264f792c1794/55b84b13-5059-5e90-832e-264f792c1794_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDL65YEY%252F2025-12-01%252Fimage%252Fea3f5888-2e8c-47cf-acb3-6d8a4253729b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DL65YEY/2025-12-01/image/ea3f5888-2e8c-47cf-acb3-6d8a4253729b_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 55b84b13-5059-5e90-832e-264f792c1794
2025-12-01 19:03:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55b84b13-5059-5e90-832e-264f792c1794, skipping ID generation
2025-12-01 19:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55b84b13-5059-5e90-832e-264f792c1794 with scrape type 1
2025-12-01 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 55b84b13-5059-5e90-832e-264f792c1794 from tracking dictionaries
2025-12-01 19:03:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55b84b13-5059-5e90-832e-264f792c1794 sending to next pipeline
2025-12-01 19:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 55b84b13-5059-5e90-832e-264f792c1794, identifier: 117625569
2025-12-01 19:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e9ab010>
2025-12-01 19:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b82772-9067-5549-932e-76f41c49ba19/28b82772-9067-5549-932e-76f41c49ba19_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO18JKK%252F2025-12-01%252Fimage%252F32cc8eb7-bec7-4cd4-9227-a31ae252f49c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO18JKK/2025-12-01/image/32cc8eb7-bec7-4cd4-9227-a31ae252f49c_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 28b82772-9067-5549-932e-76f41c49ba19
2025-12-01 19:03:08 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117395964, 'registration': 'LT74PGO', 'account': 'MOT070', 'make': 'MERCEDES-BENZ', 'model': 'GLA HATCHBACK', 'derivative': 'GLA 200 AMG Line Premium 5dr Auto', 'mileage': 24771, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-10-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LT74PGO/2025-11-21/image/fc78be48-d16a-4b51-ba5f-462c2fc036cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/ba76bcc3-8a4c-43f8-b0f0-616c1d383259_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/5fd5ef5a-fab7-42ae-9738-5351c6cc472f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/e4d68599-532a-4bbe-884f-f4a88f9ac699_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/3873d6cd-5063-4a36-9827-7b9cd03323a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/750b4384-eafe-48a6-9ee1-51482c8077a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/f63042ba-0c73-4d2b-a2ed-e278b8e2b06f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/91017f22-9fea-4e74-b8e8-8a1b002cbc9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/443f35c6-b669-43bb-b5f5-b6a21fc9df5f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 158, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6bc4c020-64b7-4f9c-a3ba-036ce8ce556e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:08 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117395964, 'registration': 'LT74PGO', 'account': 'MOT070', 'make': 'MERCEDES-BENZ', 'model': 'GLA HATCHBACK', 'derivative': 'GLA 200 AMG Line Premium 5dr Auto', 'mileage': 24771, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-10-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LT74PGO/2025-11-21/image/fc78be48-d16a-4b51-ba5f-462c2fc036cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/ba76bcc3-8a4c-43f8-b0f0-616c1d383259_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/5fd5ef5a-fab7-42ae-9738-5351c6cc472f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/e4d68599-532a-4bbe-884f-f4a88f9ac699_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/3873d6cd-5063-4a36-9827-7b9cd03323a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/750b4384-eafe-48a6-9ee1-51482c8077a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/f63042ba-0c73-4d2b-a2ed-e278b8e2b06f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/91017f22-9fea-4e74-b8e8-8a1b002cbc9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/443f35c6-b669-43bb-b5f5-b6a21fc9df5f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 158, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6bc4c020-64b7-4f9c-a3ba-036ce8ce556e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6ff7ec9-3cc9-5036-b785-6abff98081d3 with identifier: 117395964
2025-12-01 19:03:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6ff7ec9-3cc9-5036-b785-6abff98081d3 with scrape type 1
2025-12-01 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item a6ff7ec9-3cc9-5036-b785-6abff98081d3
2025-12-01 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLT74PGO%252F2025-11-21%252Fimage%252Ffc78be48-d16a-4b51-ba5f-462c2fc036cc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT74PGO/2025-11-21/image/fc78be48-d16a-4b51-ba5f-462c2fc036cc_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO18JKK/2025-12-01/image/874341f9-f211-491b-87ca-e9698be01f8e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117627785?view=catalogue)
2025-12-01 19:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a7fd25af-1c0c-5745-a7fa-634525bcac68 with identifier: 117631028
2025-12-01 19:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a7fd25af-1c0c-5745-a7fa-634525bcac68 with identifier: 117631028
2025-12-01 19:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 10, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'hyundai kona electric hatchback 115kw advance 48kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'kona electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 3924, 'odometer_reading_unit': 'mi', 'registration_date': '2024-12-23', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117631028', 'expiration_date': '2025-12-09t10:15:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '115kw advance 48kwh 5dr auto', 'license_plate': 'wm74sku', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'a7fd25af-1c0c-5745-a7fa-634525bcac68', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/b36bc038-1ceb-4985-b979-7d44e34d38f4_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34761}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/ad2cffda-bd26-48eb-96ed-5eb93761ff11_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32466}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/1ca77b06-d499-49f2-9c80-7f072067b589_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 36150}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/988bb02b-b1e1-4657-a0d7-52cce11f65ee_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 35497}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/587dfa67-ca2c-494b-828e-c6a280ec1e9f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 38214}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/8890e246-99e3-455b-bba6-a2f679994482_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 45335}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/e4e81195-fdef-41a2-9e68-635f3ef09faf_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50529}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/496a4694-5649-4221-b3cb-00663c6294a5_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 57145}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/c9ae33f4-eb6f-46f9-b3dc-22283d870fc2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 55285}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/882a1277-8154-4c61-ac9b-05ebbfb39dab_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 38564}], 'current_year_diff': 1, 'age_in_months': 11, 'make_model': 'hyundai kona electric hatchback', 'sanitized_make': 'hyundai', 'odometer_in_km': 6315} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 11,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-09t10:15:00z',
     'fuel_type': 'electric',
     'id': 'a7fd25af-1c0c-5745-a7fa-634525bcac68',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'wm74sku',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117631028',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'hyundai',
     'make_model': 'hyundai kona electric hatchback',
     'model': 'kona electric hatchback',
     'odometer': 3924,
     'odometer_in_km': 6315,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 10,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34761,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/b36bc038-1ceb-4985-b979-7d44e34d38f4_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32466,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/ad2cffda-bd26-48eb-96ed-5eb93761ff11_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 36150,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/1ca77b06-d499-49f2-9c80-7f072067b589_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 35497,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/988bb02b-b1e1-4657-a0d7-52cce11f65ee_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 38214,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/587dfa67-ca2c-494b-828e-c6a280ec1e9f_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45335,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/8890e246-99e3-455b-bba6-a2f679994482_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50529,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/e4e81195-fdef-41a2-9e68-635f3ef09faf_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57145,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/496a4694-5649-4221-b3cb-00663c6294a5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55285,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/c9ae33f4-eb6f-46f9-b3dc-22283d870fc2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 38564,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/882a1277-8154-4c61-ac9b-05ebbfb39dab_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-12-23',
     'sanitized_make': 'hyundai',
     'seller_name': 'motability operations',
     'title': 'hyundai kona electric hatchback 115kw advance 48kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '115kw advance 48kwh 5dr auto',
     'vin': None,
     'year': 2024}
2025-12-01 19:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: a7fd25af-1c0c-5745-a7fa-634525bcac68 spider: astonbarclay.gb
2025-12-01 19:03:08 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: a7fd25af-1c0c-5745-a7fa-634525bcac68 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 10, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'hyundai kona electric hatchback 115kw advance 48kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'kona electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 3924, 'odometer_reading_unit': 'mi', 'registration_date': '2024-12-23', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117631028', 'expiration_date': '2025-12-09t10:15:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '115kw advance 48kwh 5dr auto', 'license_plate': 'wm74sku', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'a7fd25af-1c0c-5745-a7fa-634525bcac68', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/b36bc038-1ceb-4985-b979-7d44e34d38f4_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34761}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/ad2cffda-bd26-48eb-96ed-5eb93761ff11_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32466}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/1ca77b06-d499-49f2-9c80-7f072067b589_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 36150}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/988bb02b-b1e1-4657-a0d7-52cce11f65ee_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 35497}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/587dfa67-ca2c-494b-828e-c6a280ec1e9f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 38214}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/8890e246-99e3-455b-bba6-a2f679994482_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 45335}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/e4e81195-fdef-41a2-9e68-635f3ef09faf_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50529}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/496a4694-5649-4221-b3cb-00663c6294a5_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 57145}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/c9ae33f4-eb6f-46f9-b3dc-22283d870fc2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 55285}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/882a1277-8154-4c61-ac9b-05ebbfb39dab_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 38564}], 'current_year_diff': 1, 'age_in_months': 11, 'make_model': 'hyundai kona electric hatchback', 'sanitized_make': 'hyundai', 'odometer_in_km': 6315} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 11,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-09t10:15:00z',
     'fuel_type': 'electric',
     'id': 'a7fd25af-1c0c-5745-a7fa-634525bcac68',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'wm74sku',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117631028',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'hyundai',
     'make_model': 'hyundai kona electric hatchback',
     'model': 'kona electric hatchback',
     'odometer': 3924,
     'odometer_in_km': 6315,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 10,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34761,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/b36bc038-1ceb-4985-b979-7d44e34d38f4_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32466,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/ad2cffda-bd26-48eb-96ed-5eb93761ff11_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 36150,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/1ca77b06-d499-49f2-9c80-7f072067b589_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 35497,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/988bb02b-b1e1-4657-a0d7-52cce11f65ee_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 38214,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/587dfa67-ca2c-494b-828e-c6a280ec1e9f_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 45335,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/8890e246-99e3-455b-bba6-a2f679994482_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50529,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/e4e81195-fdef-41a2-9e68-635f3ef09faf_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57145,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/496a4694-5649-4221-b3cb-00663c6294a5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 55285,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/c9ae33f4-eb6f-46f9-b3dc-22283d870fc2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 38564,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/882a1277-8154-4c61-ac9b-05ebbfb39dab_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-12-23',
     'sanitized_make': 'hyundai',
     'seller_name': 'motability operations',
     'title': 'hyundai kona electric hatchback 115kw advance 48kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '115kw advance 48kwh 5dr auto',
     'vin': None,
     'year': 2024}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Electric',
 'id': 'a7fd25af-1c0c-5745-a7fa-634525bcac68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WM74SKU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117631028',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'HYUNDAI',
 'model': 'KONA ELECTRIC HATCHBACK',
 'odometer': 3924,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34761,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/b36bc038-1ceb-4985-b979-7d44e34d38f4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32466,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/ad2cffda-bd26-48eb-96ed-5eb93761ff11_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36150,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/1ca77b06-d499-49f2-9c80-7f072067b589_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35497,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/988bb02b-b1e1-4657-a0d7-52cce11f65ee_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38214,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/587dfa67-ca2c-494b-828e-c6a280ec1e9f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45335,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/8890e246-99e3-455b-bba6-a2f679994482_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50529,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/e4e81195-fdef-41a2-9e68-635f3ef09faf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57145,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/496a4694-5649-4221-b3cb-00663c6294a5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55285,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/c9ae33f4-eb6f-46f9-b3dc-22283d870fc2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fd25af-1c0c-5745-a7fa-634525bcac68/a7fd25af-1c0c-5745-a7fa-634525bcac68_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38564,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WM74SKU/2025-12-01/image/882a1277-8154-4c61-ac9b-05ebbfb39dab_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-23',
 'seller_name': 'Motability Operations',
 'title': 'HYUNDAI KONA ELECTRIC HATCHBACK 115kW Advance 48kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '115kW Advance 48kWh 5dr Auto',
 'vin': None,
 'year': 2024}
2025-12-01 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117631028%27 HTTP/1.1" 200 None
2025-12-01 19:03:08 [astonbarclay.gb] INFO: Saving data for 117631028: {'created_time': 1764615788.432351, 'last_price_update_time': 1764615788.432363, 'auction_closing_time': 1765275300.0}
2025-12-01 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117631028') HTTP/1.1" 204 0
2025-12-01 19:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 55b84b13-5059-5e90-832e-264f792c1794 with identifier: 117625569
2025-12-01 19:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 55b84b13-5059-5e90-832e-264f792c1794 with identifier: 117625569
2025-12-01 19:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-01 19:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 55b84b13-5059-5e90-832e-264f792c1794 spider: astonbarclay.gb
2025-12-01 19:03:08 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 55b84b13-5059-5e90-832e-264f792c1794 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '55b84b13-5059-5e90-832e-264f792c1794',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DL65YEY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117625569',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'MERIVA ESTATE',
 'odometer': 50577,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b84b13-5059-5e90-832e-264f792c1794/55b84b13-5059-5e90-832e-264f792c1794_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35826,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DL65YEY/2025-12-01/image/eb271ef4-7275-49e1-a9cd-fdef222bc9ba_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b84b13-5059-5e90-832e-264f792c1794/55b84b13-5059-5e90-832e-264f792c1794_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35589,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DL65YEY/2025-12-01/image/9746eaad-1d40-4b83-b94d-1681d376489b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b84b13-5059-5e90-832e-264f792c1794/55b84b13-5059-5e90-832e-264f792c1794_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30922,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DL65YEY/2025-12-01/image/6c93eda8-867e-465e-a360-30b445604ba3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b84b13-5059-5e90-832e-264f792c1794/55b84b13-5059-5e90-832e-264f792c1794_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30246,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DL65YEY/2025-12-01/image/c69af0e2-4c36-4494-8bae-9b0792d89f9d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b84b13-5059-5e90-832e-264f792c1794/55b84b13-5059-5e90-832e-264f792c1794_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54139,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DL65YEY/2025-12-01/image/b8204fef-d2d0-467d-bb62-35c3d9021178_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b84b13-5059-5e90-832e-264f792c1794/55b84b13-5059-5e90-832e-264f792c1794_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46854,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DL65YEY/2025-12-01/image/86d3aec2-736c-4c54-8c9e-435a5f6a2a3e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b84b13-5059-5e90-832e-264f792c1794/55b84b13-5059-5e90-832e-264f792c1794_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38409,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DL65YEY/2025-12-01/image/efcded0f-9045-4fcd-b148-1c4daa8f761a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b84b13-5059-5e90-832e-264f792c1794/55b84b13-5059-5e90-832e-264f792c1794_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39529,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DL65YEY/2025-12-01/image/c632fbac-3073-48ee-8bf1-82b49a0527b2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55b84b13-5059-5e90-832e-264f792c1794/55b84b13-5059-5e90-832e-264f792c1794_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49114,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DL65YEY/2025-12-01/image/ea3f5888-2e8c-47cf-acb3-6d8a4253729b_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-18',
 'seller_name': 'UKCGR',
 'title': 'VAUXHALL MERIVA ESTATE 1.4T 16V Exclusiv 5dr',
 'transmission': 'manual',
 'trim': '1.4T 16V Exclusiv 5dr',
 'vin': None,
 'year': 2015}
2025-12-01 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117625569%27 HTTP/1.1" 200 None
2025-12-01 19:03:08 [astonbarclay.gb] INFO: Saving data for 117625569: {'created_time': 1764615788.671894, 'last_price_update_time': 1764615788.671904}
2025-12-01 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117625569') HTTP/1.1" 204 0
2025-12-01 19:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e604890>
2025-12-01 19:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9a2d1f-5d0f-5846-b610-9c0e398774d5/3f9a2d1f-5d0f-5846-b610-9c0e398774d5_image_12.jpg HTTP/1.1" 201 0
2025-12-01 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPK18ANU%252F2025-12-01%252Fimage%252Fa75f8eaf-dabb-4ce5-908b-ed613f766818_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK18ANU/2025-12-01/image/a75f8eaf-dabb-4ce5-908b-ed613f766818_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3f9a2d1f-5d0f-5846-b610-9c0e398774d5
2025-12-01 19:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e5a3d10>
2025-12-01 19:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1d41c3-9a55-5035-95b3-78f2642f8712/8d1d41c3-9a55-5035-95b3-78f2642f8712_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAGZ6324%252F2025-11-20%252Fimage%252F51b98e9a-1ced-4cce-8c82-14bd500e0a3c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AGZ6324/2025-11-20/image/51b98e9a-1ced-4cce-8c82-14bd500e0a3c_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8d1d41c3-9a55-5035-95b3-78f2642f8712
2025-12-01 19:03:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117394487, 'registration': 'AP74FTD', 'account': 'MOT070', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi 241 PHEV GT-Line 5dr Auto AWD', 'mileage': 16218, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-01-28', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/AP74FTD/2025-11-21/image/e100cf27-028c-41a5-8b00-2a23162381fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/071fdd9e-b2f0-4ee5-92f3-5c36034febfd_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/01f5b861-641a-4d01-96fa-d725b39b2f1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/da028012-3e27-4e83-bc3d-471d864f6ab2_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/b130b72f-71c1-4c32-9e77-298a592c3f67_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/be9f1ba6-ef7e-4818-abb3-cd4c4f0958d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/a5ff6f6f-ec51-4f61-9b17-11d20da18da4_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/cbba9733-326e-48d6-aabc-83083fdfab0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/20030a71-fa87-49db-99ec-df66757c4dea_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/d76f266c-28b8-409f-a1a2-c5d55d942696_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book 08/25 10k', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 27, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dedfe391-9033-4f97-9b4d-697db0220075.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117394487, 'registration': 'AP74FTD', 'account': 'MOT070', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi 241 PHEV GT-Line 5dr Auto AWD', 'mileage': 16218, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-01-28', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/AP74FTD/2025-11-21/image/e100cf27-028c-41a5-8b00-2a23162381fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/071fdd9e-b2f0-4ee5-92f3-5c36034febfd_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/01f5b861-641a-4d01-96fa-d725b39b2f1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/da028012-3e27-4e83-bc3d-471d864f6ab2_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/b130b72f-71c1-4c32-9e77-298a592c3f67_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/be9f1ba6-ef7e-4818-abb3-cd4c4f0958d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/a5ff6f6f-ec51-4f61-9b17-11d20da18da4_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/cbba9733-326e-48d6-aabc-83083fdfab0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/20030a71-fa87-49db-99ec-df66757c4dea_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/d76f266c-28b8-409f-a1a2-c5d55d942696_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book 08/25 10k', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 27, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dedfe391-9033-4f97-9b4d-697db0220075.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aee9ea4a-1d35-54dd-ac37-06a67c77e6ec with identifier: 117394487
2025-12-01 19:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aee9ea4a-1d35-54dd-ac37-06a67c77e6ec with scrape type 1
2025-12-01 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aee9ea4a-1d35-54dd-ac37-06a67c77e6ec
2025-12-01 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAP74FTD%252F2025-11-21%252Fimage%252Fe100cf27-028c-41a5-8b00-2a23162381fe_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP74FTD/2025-11-21/image/e100cf27-028c-41a5-8b00-2a23162381fe_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX20XCS/2025-12-01/image/d64ecc6c-eee9-4d52-a826-69e6fb62a5e5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117549150?view=catalogue)
2025-12-01 19:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV22BSX/2025-12-01/image/efcd5959-e99a-4836-a568-d5de20943c2b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117576078?view=catalogue)
2025-12-01 19:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LB66AVM/2025-12-01/image/1edf8ba4-345d-4c2c-a13c-c588b2af83ce_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117583759?view=catalogue)
2025-12-01 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLT74PGO%252F2025-11-21%252Fimage%252Fba76bcc3-8a4c-43f8-b0f0-616c1d383259_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT74PGO/2025-11-21/image/ba76bcc3-8a4c-43f8-b0f0-616c1d383259_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117492820?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:03:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e71d0d0>
2025-12-01 19:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f9a2d1f-5d0f-5846-b610-9c0e398774d5/3f9a2d1f-5d0f-5846-b610-9c0e398774d5_image_13.jpg HTTP/1.1" 201 0
2025-12-01 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPK18ANU%252F2025-12-01%252Fimage%252F781c893c-f9ad-4553-981e-0dcae7733f70_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PK18ANU/2025-12-01/image/781c893c-f9ad-4553-981e-0dcae7733f70_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3f9a2d1f-5d0f-5846-b610-9c0e398774d5
2025-12-01 19:03:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f9a2d1f-5d0f-5846-b610-9c0e398774d5, skipping ID generation
2025-12-01 19:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f9a2d1f-5d0f-5846-b610-9c0e398774d5 with scrape type 1
2025-12-01 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3f9a2d1f-5d0f-5846-b610-9c0e398774d5 from tracking dictionaries
2025-12-01 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f9a2d1f-5d0f-5846-b610-9c0e398774d5 sending to next pipeline
2025-12-01 19:03:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3f9a2d1f-5d0f-5846-b610-9c0e398774d5, identifier: 117625254
2025-12-01 19:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e84b5d0>
2025-12-01 19:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b82772-9067-5549-932e-76f41c49ba19/28b82772-9067-5549-932e-76f41c49ba19_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO18JKK%252F2025-12-01%252Fimage%252Fb43f7eb7-bd59-43c4-932b-7aad6701dfd8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO18JKK/2025-12-01/image/b43f7eb7-bd59-43c4-932b-7aad6701dfd8_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 28b82772-9067-5549-932e-76f41c49ba19
2025-12-01 19:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EO18JKK/2025-12-01/image/3f5ead84-988d-41cf-8cf5-0a15dfd879f5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117627785?view=catalogue)
2025-12-01 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAP74FTD%252F2025-11-21%252Fimage%252F071fdd9e-b2f0-4ee5-92f3-5c36034febfd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP74FTD/2025-11-21/image/071fdd9e-b2f0-4ee5-92f3-5c36034febfd_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3f9a2d1f-5d0f-5846-b610-9c0e398774d5 with identifier: 117625254
2025-12-01 19:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3f9a2d1f-5d0f-5846-b610-9c0e398774d5 with identifier: 117625254
2025-12-01 19:03:09 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3f9a2d1f-5d0f-5846-b610-9c0e398774d5 with identifier: 117625254 to the API
2025-12-01 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:03:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/PK18ANU/2025-12-01/image/781c893c-f9ad-4553-981e-0dcae7733f70_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 183,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '3f9a2d1f-5d0f-5846-b610-9c0e398774d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PK18ANU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117625254',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': 'X5 DIESEL ESTATE',
 'odometer': 85981,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9a2d1f-5d0f-5846-b610-9c0e398774d5/3f9a2d1f-5d0f-5846-b610-9c0e398774d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27420,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/fa6140ba-06bf-4290-88f2-9a067c8148d8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9a2d1f-5d0f-5846-b610-9c0e398774d5/3f9a2d1f-5d0f-5846-b610-9c0e398774d5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25798,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/cbb8b071-c90f-45ef-9f05-5df7678a4fdc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9a2d1f-5d0f-5846-b610-9c0e398774d5/3f9a2d1f-5d0f-5846-b610-9c0e398774d5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29006,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/ced25ed9-c49f-4bdd-8164-b56a0881dae7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9a2d1f-5d0f-5846-b610-9c0e398774d5/3f9a2d1f-5d0f-5846-b610-9c0e398774d5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28907,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/f23f2cf3-9eec-4329-85c7-7093c5c1720c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9a2d1f-5d0f-5846-b610-9c0e398774d5/3f9a2d1f-5d0f-5846-b610-9c0e398774d5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42304,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/c5e5975c-eca4-472a-89d8-c60114f01127_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9a2d1f-5d0f-5846-b610-9c0e398774d5/3f9a2d1f-5d0f-5846-b610-9c0e398774d5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43166,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/84b0205b-d81e-4fda-96e2-5ed8e4999d56_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9a2d1f-5d0f-5846-b610-9c0e398774d5/3f9a2d1f-5d0f-5846-b610-9c0e398774d5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42477,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/cb2957d0-de69-476f-978a-4bb05a04478c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9a2d1f-5d0f-5846-b610-9c0e398774d5/3f9a2d1f-5d0f-5846-b610-9c0e398774d5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100461,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/8db11a3b-e74d-4b44-8448-e50fdea3d811_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9a2d1f-5d0f-5846-b610-9c0e398774d5/3f9a2d1f-5d0f-5846-b610-9c0e398774d5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92393,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/fd8bd7f3-e8a5-4517-9f61-7516fc265415_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9a2d1f-5d0f-5846-b610-9c0e398774d5/3f9a2d1f-5d0f-5846-b610-9c0e398774d5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 18236,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/12fe1d66-65e9-4e58-a7f9-1575c7715089_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9a2d1f-5d0f-5846-b610-9c0e398774d5/3f9a2d1f-5d0f-5846-b610-9c0e398774d5_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50853,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/f7c371da-7154-457a-89df-bc46f97ade8a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9a2d1f-5d0f-5846-b610-9c0e398774d5/3f9a2d1f-5d0f-5846-b610-9c0e398774d5_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43966,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/4f7deb18-1649-472f-9cf3-3497394c3c9c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9a2d1f-5d0f-5846-b610-9c0e398774d5/3f9a2d1f-5d0f-5846-b610-9c0e398774d5_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29006,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/a75f8eaf-dabb-4ce5-908b-ed613f766818_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f9a2d1f-5d0f-5846-b610-9c0e398774d5/3f9a2d1f-5d0f-5846-b610-9c0e398774d5_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46761,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/PK18ANU/2025-12-01/image/781c893c-f9ad-4553-981e-0dcae7733f70_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-28',
 'seller_name': 'UKCGR',
 'title': 'BMW X5 DIESEL ESTATE xDrive40d M Sport 5dr Auto [7 Seat]',
 'transmission': 'automatic',
 'trim': 'xDrive40d M Sport 5dr Auto [7 Seat]',
 'vin': None,
 'year': 2018}
2025-12-01 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117625254%27 HTTP/1.1" 200 None
2025-12-01 19:03:10 [astonbarclay.gb] INFO: Saving data for 117625254: {'created_time': 1764615790.296704, 'last_price_update_time': 1764615790.296713}
2025-12-01 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117625254') HTTP/1.1" 204 0
2025-12-01 19:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f23dc10>
2025-12-01 19:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1d41c3-9a55-5035-95b3-78f2642f8712/8d1d41c3-9a55-5035-95b3-78f2642f8712_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAGZ6324%252F2025-11-20%252Fimage%252F38c76a2d-bd26-4a20-ae91-47ad52873139_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AGZ6324/2025-11-20/image/38c76a2d-bd26-4a20-ae91-47ad52873139_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d1d41c3-9a55-5035-95b3-78f2642f8712
2025-12-01 19:03:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d1d41c3-9a55-5035-95b3-78f2642f8712, skipping ID generation
2025-12-01 19:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d1d41c3-9a55-5035-95b3-78f2642f8712 with scrape type 1
2025-12-01 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8d1d41c3-9a55-5035-95b3-78f2642f8712 from tracking dictionaries
2025-12-01 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d1d41c3-9a55-5035-95b3-78f2642f8712 sending to next pipeline
2025-12-01 19:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8d1d41c3-9a55-5035-95b3-78f2642f8712, identifier: 117366549
2025-12-01 19:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f25f310>
2025-12-01 19:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4471d1-1330-5f18-bc6b-f50165d7cebc/9b4471d1-1330-5f18-bc6b-f50165d7cebc_image_10.jpg HTTP/1.1" 201 0
2025-12-01 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fe68f76e3-5134-4041-abe5-4fef8c59ae05.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/e68f76e3-5134-4041-abe5-4fef8c59ae05.jpg?w=600 saved to cache
2025-12-01 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9b4471d1-1330-5f18-bc6b-f50165d7cebc
2025-12-01 19:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e994cd0>
2025-12-01 19:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4471d1-1330-5f18-bc6b-f50165d7cebc/9b4471d1-1330-5f18-bc6b-f50165d7cebc_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F299edf6b-fd89-4b09-bc7b-cbbca3dae92f.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/299edf6b-fd89-4b09-bc7b-cbbca3dae92f.jpg?w=600 saved to cache
2025-12-01 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b4471d1-1330-5f18-bc6b-f50165d7cebc
2025-12-01 19:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/ET17TNV/2025-12-01/image/9af11aa6-f189-488f-8341-502ca7506746_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117596913?view=catalogue)
2025-12-01 19:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/GC65DZW/2025-11-26/image/a128af62-2e45-4fa6-8bf7-680f3eda5aa4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117495142?view=catalogue)
2025-12-01 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLT74PGO%252F2025-11-21%252Fimage%252F5fd5ef5a-fab7-42ae-9738-5351c6cc472f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT74PGO/2025-11-21/image/5fd5ef5a-fab7-42ae-9738-5351c6cc472f_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8d1d41c3-9a55-5035-95b3-78f2642f8712 with identifier: 117366549
2025-12-01 19:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8d1d41c3-9a55-5035-95b3-78f2642f8712 with identifier: 117366549
2025-12-01 19:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 130673 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    130673
2025-12-01 19:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 8d1d41c3-9a55-5035-95b3-78f2642f8712 spider: astonbarclay.gb
2025-12-01 19:03:11 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 8d1d41c3-9a55-5035-95b3-78f2642f8712 due to rule: high_mileage_for_make.json, error: 130673 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    130673
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '8d1d41c3-9a55-5035-95b3-78f2642f8712',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AGZ6324',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117366549',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'PEUGEOT',
 'model': '308 DIESEL HATCHBACK',
 'odometer': 81197,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1d41c3-9a55-5035-95b3-78f2642f8712/8d1d41c3-9a55-5035-95b3-78f2642f8712_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34566,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/38c76a2d-bd26-4a20-ae91-47ad52873139_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1d41c3-9a55-5035-95b3-78f2642f8712/8d1d41c3-9a55-5035-95b3-78f2642f8712_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33899,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/82383630-4335-41a7-accc-e663916cc43f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1d41c3-9a55-5035-95b3-78f2642f8712/8d1d41c3-9a55-5035-95b3-78f2642f8712_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35258,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/c4816a9a-bec7-4018-aa0e-12a4af35d00e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1d41c3-9a55-5035-95b3-78f2642f8712/8d1d41c3-9a55-5035-95b3-78f2642f8712_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37281,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/32fb6d3b-f9f0-4692-9be9-cc39a5c3ed36_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1d41c3-9a55-5035-95b3-78f2642f8712/8d1d41c3-9a55-5035-95b3-78f2642f8712_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44086,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/51b98e9a-1ced-4cce-8c82-14bd500e0a3c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1d41c3-9a55-5035-95b3-78f2642f8712/8d1d41c3-9a55-5035-95b3-78f2642f8712_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59994,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/38e90add-4c25-423d-8f23-4d4c55296da8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1d41c3-9a55-5035-95b3-78f2642f8712/8d1d41c3-9a55-5035-95b3-78f2642f8712_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54347,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/677c4639-db7f-4981-b0cd-1eace3bbaf49_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1d41c3-9a55-5035-95b3-78f2642f8712/8d1d41c3-9a55-5035-95b3-78f2642f8712_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44951,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/1e157848-7440-412b-ba3f-c616f234cca1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1d41c3-9a55-5035-95b3-78f2642f8712/8d1d41c3-9a55-5035-95b3-78f2642f8712_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55234,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AGZ6324/2025-11-20/image/4c4b08ca-f6e7-4fc6-9f40-7f0695d05a60_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-29',
 'seller_name': 'Zuto',
 'title': 'PEUGEOT 308 DIESEL HATCHBACK 2.0 BlueHDi 180 GT 5dr EAT6',
 'transmission': 'automatic',
 'trim': '2.0 BlueHDi 180 GT 5dr EAT6',
 'vin': None,
 'year': 2016}
2025-12-01 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117366549%27 HTTP/1.1" 200 None
2025-12-01 19:03:11 [astonbarclay.gb] INFO: Saving data for 117366549: {'created_time': 1764615791.360269, 'last_price_update_time': 1764615791.360279, 'auction_closing_time': 1765285200.0}
2025-12-01 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117366549') HTTP/1.1" 204 0
2025-12-01 19:03:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e5932d0>
2025-12-01 19:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b82772-9067-5549-932e-76f41c49ba19/28b82772-9067-5549-932e-76f41c49ba19_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO18JKK%252F2025-12-01%252Fimage%252F874341f9-f211-491b-87ca-e9698be01f8e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO18JKK/2025-12-01/image/874341f9-f211-491b-87ca-e9698be01f8e_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 28b82772-9067-5549-932e-76f41c49ba19
2025-12-01 19:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DE17YWV/2025-12-01/image/02290c2b-fba6-4006-a1eb-be44ffc2f211_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117636439?view=catalogue)
2025-12-01 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAP74FTD%252F2025-11-21%252Fimage%252F01f5b861-641a-4d01-96fa-d725b39b2f1a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP74FTD/2025-11-21/image/01f5b861-641a-4d01-96fa-d725b39b2f1a_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e542250>
2025-12-01 19:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7800d3dd-b271-56f9-9c1d-5a1b4b402c50/7800d3dd-b271-56f9-9c1d-5a1b4b402c50_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX20XCS%252F2025-12-01%252Fimage%252Fd64ecc6c-eee9-4d52-a826-69e6fb62a5e5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX20XCS/2025-12-01/image/d64ecc6c-eee9-4d52-a826-69e6fb62a5e5_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7800d3dd-b271-56f9-9c1d-5a1b4b402c50
2025-12-01 19:03:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7800d3dd-b271-56f9-9c1d-5a1b4b402c50, skipping ID generation
2025-12-01 19:03:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7800d3dd-b271-56f9-9c1d-5a1b4b402c50 with scrape type 1
2025-12-01 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7800d3dd-b271-56f9-9c1d-5a1b4b402c50 from tracking dictionaries
2025-12-01 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7800d3dd-b271-56f9-9c1d-5a1b4b402c50 sending to next pipeline
2025-12-01 19:03:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7800d3dd-b271-56f9-9c1d-5a1b4b402c50, identifier: 117549150
2025-12-01 19:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e7c3d10>
2025-12-01 19:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49ea86bd-0188-543f-9dff-87dbf2d122aa/49ea86bd-0188-543f-9dff-87dbf2d122aa_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV22BSX%252F2025-12-01%252Fimage%252Fefcd5959-e99a-4836-a568-d5de20943c2b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV22BSX/2025-12-01/image/efcd5959-e99a-4836-a568-d5de20943c2b_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 49ea86bd-0188-543f-9dff-87dbf2d122aa
2025-12-01 19:03:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49ea86bd-0188-543f-9dff-87dbf2d122aa, skipping ID generation
2025-12-01 19:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49ea86bd-0188-543f-9dff-87dbf2d122aa with scrape type 1
2025-12-01 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 49ea86bd-0188-543f-9dff-87dbf2d122aa from tracking dictionaries
2025-12-01 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49ea86bd-0188-543f-9dff-87dbf2d122aa sending to next pipeline
2025-12-01 19:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 49ea86bd-0188-543f-9dff-87dbf2d122aa, identifier: 117576078
2025-12-01 19:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e77ab50>
2025-12-01 19:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91e3816c-1299-58c7-b5f9-71f70184e072/91e3816c-1299-58c7-b5f9-71f70184e072_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLB66AVM%252F2025-12-01%252Fimage%252F1edf8ba4-345d-4c2c-a13c-c588b2af83ce_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LB66AVM/2025-12-01/image/1edf8ba4-345d-4c2c-a13c-c588b2af83ce_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 91e3816c-1299-58c7-b5f9-71f70184e072
2025-12-01 19:03:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 91e3816c-1299-58c7-b5f9-71f70184e072, skipping ID generation
2025-12-01 19:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91e3816c-1299-58c7-b5f9-71f70184e072 with scrape type 1
2025-12-01 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 91e3816c-1299-58c7-b5f9-71f70184e072 from tracking dictionaries
2025-12-01 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 91e3816c-1299-58c7-b5f9-71f70184e072 sending to next pipeline
2025-12-01 19:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 91e3816c-1299-58c7-b5f9-71f70184e072, identifier: 117583759
2025-12-01 19:03:12 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117492820, 'registration': 'LN73OFU', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH Acenta Premium 5dr', 'mileage': 20465, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-12-14', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LN73OFU/2025-11-27/image/78f7c909-3bf2-4c31-aaf7-b56b4f56787a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/921414e8-64e3-448b-a152-f2e85f71fb43_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/b3bd0ada-53fe-47b8-a0ce-b3eaf660abbb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/be2d3a6c-129c-4222-a0a2-8ea76016b1a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/996933d0-7acf-45f9-b2db-93487c637ed8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/20c329c2-4789-4011-9437-56b7d16d0930_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/1f8e0753-883a-4bc4-bb1d-cce4fddfed12_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/45f27f64-03f4-40e9-ad51-11ed32688d29_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/54e18268-bd12-40ae-a9cb-b13f9d777c3a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 11/24 9k', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - SPARE KEY IN OFFCE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/282f6c85-c576-418e-8cc1-509b0b15c8d0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:12 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117492820, 'registration': 'LN73OFU', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH Acenta Premium 5dr', 'mileage': 20465, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-12-14', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LN73OFU/2025-11-27/image/78f7c909-3bf2-4c31-aaf7-b56b4f56787a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/921414e8-64e3-448b-a152-f2e85f71fb43_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/b3bd0ada-53fe-47b8-a0ce-b3eaf660abbb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/be2d3a6c-129c-4222-a0a2-8ea76016b1a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/996933d0-7acf-45f9-b2db-93487c637ed8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/20c329c2-4789-4011-9437-56b7d16d0930_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/1f8e0753-883a-4bc4-bb1d-cce4fddfed12_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/45f27f64-03f4-40e9-ad51-11ed32688d29_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/54e18268-bd12-40ae-a9cb-b13f9d777c3a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 11/24 9k', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - SPARE KEY IN OFFCE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/282f6c85-c576-418e-8cc1-509b0b15c8d0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2b4c2d7-187b-5876-a316-a5afbbcf6cdf with identifier: 117492820
2025-12-01 19:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2b4c2d7-187b-5876-a316-a5afbbcf6cdf with scrape type 1
2025-12-01 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item f2b4c2d7-187b-5876-a316-a5afbbcf6cdf
2025-12-01 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLN73OFU%252F2025-11-27%252Fimage%252F78f7c909-3bf2-4c31-aaf7-b56b4f56787a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN73OFU/2025-11-27/image/78f7c909-3bf2-4c31-aaf7-b56b4f56787a_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WL19RLV/2025-12-01/image/af3fc48b-79a9-46a1-a39f-3f4904e08f5d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117632563?view=catalogue)
2025-12-01 19:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LT74PGO/2025-11-21/image/fc78be48-d16a-4b51-ba5f-462c2fc036cc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117395964?view=catalogue)
2025-12-01 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLT74PGO%252F2025-11-21%252Fimage%252Fe4d68599-532a-4bbe-884f-f4a88f9ac699_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT74PGO/2025-11-21/image/e4d68599-532a-4bbe-884f-f4a88f9ac699_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117415829?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7800d3dd-b271-56f9-9c1d-5a1b4b402c50 with identifier: 117549150
2025-12-01 19:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7800d3dd-b271-56f9-9c1d-5a1b4b402c50 with identifier: 117549150
2025-12-01 19:03:12 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7800d3dd-b271-56f9-9c1d-5a1b4b402c50 with identifier: 117549150 to the API
2025-12-01 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EX20XCS/2025-12-01/image/d64ecc6c-eee9-4d52-a826-69e6fb62a5e5_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '7800d3dd-b271-56f9-9c1d-5a1b4b402c50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EX20XCS',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117549150',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'B CLASS DIESEL HATCHBACK',
 'odometer': 61683,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7800d3dd-b271-56f9-9c1d-5a1b4b402c50/7800d3dd-b271-56f9-9c1d-5a1b4b402c50_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36516,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/d64ecc6c-eee9-4d52-a826-69e6fb62a5e5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7800d3dd-b271-56f9-9c1d-5a1b4b402c50/7800d3dd-b271-56f9-9c1d-5a1b4b402c50_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35952,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/2299d1ed-3acf-4119-92ce-6411aefa8183_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7800d3dd-b271-56f9-9c1d-5a1b4b402c50/7800d3dd-b271-56f9-9c1d-5a1b4b402c50_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38352,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/91491da4-8199-44f4-90b0-2d80f5f5a373_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7800d3dd-b271-56f9-9c1d-5a1b4b402c50/7800d3dd-b271-56f9-9c1d-5a1b4b402c50_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38176,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/be057c18-49cf-4429-9c61-e5ca012cc4be_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7800d3dd-b271-56f9-9c1d-5a1b4b402c50/7800d3dd-b271-56f9-9c1d-5a1b4b402c50_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55880,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/0f10db47-9ddd-45ff-86da-1fee84a2b99b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7800d3dd-b271-56f9-9c1d-5a1b4b402c50/7800d3dd-b271-56f9-9c1d-5a1b4b402c50_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44026,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/05bb4e19-6169-4e76-a250-55b6df2a9397_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7800d3dd-b271-56f9-9c1d-5a1b4b402c50/7800d3dd-b271-56f9-9c1d-5a1b4b402c50_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40856,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/49947d55-ecbb-492d-ac6d-d04877c6132d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7800d3dd-b271-56f9-9c1d-5a1b4b402c50/7800d3dd-b271-56f9-9c1d-5a1b4b402c50_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35441,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/9718708b-b93c-4ca1-8b3a-8e1ab8f38740_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7800d3dd-b271-56f9-9c1d-5a1b4b402c50/7800d3dd-b271-56f9-9c1d-5a1b4b402c50_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51650,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/c19aab74-26a0-4bff-bff0-d40950415a78_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7800d3dd-b271-56f9-9c1d-5a1b4b402c50/7800d3dd-b271-56f9-9c1d-5a1b4b402c50_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53317,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/ea315940-8e43-49ec-9a90-f19bdbd26be1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7800d3dd-b271-56f9-9c1d-5a1b4b402c50/7800d3dd-b271-56f9-9c1d-5a1b4b402c50_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46883,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX20XCS/2025-12-01/image/7b245dc6-60f8-42f7-b646-67b0d3916239_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-19',
 'seller_name': 'Hedin Automotive',
 'title': 'MERCEDES-BENZ B CLASS DIESEL HATCHBACK B200d AMG Line Premium 5dr '
          'Auto',
 'transmission': 'automatic',
 'trim': 'B200d AMG Line Premium 5dr Auto',
 'vin': None,
 'year': 2020}
2025-12-01 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549150%27 HTTP/1.1" 200 None
2025-12-01 19:03:13 [astonbarclay.gb] INFO: Saving data for 117549150: {'created_time': 1764615793.117517, 'last_price_update_time': 1764615793.117526, 'auction_closing_time': 1764756000.0}
2025-12-01 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117549150') HTTP/1.1" 204 0
2025-12-01 19:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 49ea86bd-0188-543f-9dff-87dbf2d122aa with identifier: 117576078
2025-12-01 19:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 49ea86bd-0188-543f-9dff-87dbf2d122aa with identifier: 117576078
2025-12-01 19:03:13 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 49ea86bd-0188-543f-9dff-87dbf2d122aa with identifier: 117576078 to the API
2025-12-01 19:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LV22BSX/2025-12-01/image/efcd5959-e99a-4836-a568-d5de20943c2b_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '49ea86bd-0188-543f-9dff-87dbf2d122aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LV22BSX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117576078',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'GLA HATCHBACK',
 'odometer': 13183,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49ea86bd-0188-543f-9dff-87dbf2d122aa/49ea86bd-0188-543f-9dff-87dbf2d122aa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42815,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/f67781b8-6a3a-4511-8d0b-db46a7bce23e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49ea86bd-0188-543f-9dff-87dbf2d122aa/49ea86bd-0188-543f-9dff-87dbf2d122aa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42740,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/b8be238b-5f38-46a9-9091-99911abefaeb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49ea86bd-0188-543f-9dff-87dbf2d122aa/49ea86bd-0188-543f-9dff-87dbf2d122aa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43978,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/05eb512c-813b-4e5d-95f5-fd51626b4ac5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49ea86bd-0188-543f-9dff-87dbf2d122aa/49ea86bd-0188-543f-9dff-87dbf2d122aa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43812,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/34efc721-5d09-4f98-8269-6cec7c402936_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49ea86bd-0188-543f-9dff-87dbf2d122aa/49ea86bd-0188-543f-9dff-87dbf2d122aa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47728,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/da2007e4-588b-48db-8e4f-baba97535507_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49ea86bd-0188-543f-9dff-87dbf2d122aa/49ea86bd-0188-543f-9dff-87dbf2d122aa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54148,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/efcd5959-e99a-4836-a568-d5de20943c2b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49ea86bd-0188-543f-9dff-87dbf2d122aa/49ea86bd-0188-543f-9dff-87dbf2d122aa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49987,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/f2f44ac0-22c4-4e06-a4b0-8b2318e1aa31_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49ea86bd-0188-543f-9dff-87dbf2d122aa/49ea86bd-0188-543f-9dff-87dbf2d122aa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49470,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/121f1a1c-cae5-4087-8b77-142d917a6b27_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49ea86bd-0188-543f-9dff-87dbf2d122aa/49ea86bd-0188-543f-9dff-87dbf2d122aa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54506,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/fa3fb67b-dfcb-4a6f-ab35-4bfc8a31420a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49ea86bd-0188-543f-9dff-87dbf2d122aa/49ea86bd-0188-543f-9dff-87dbf2d122aa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49199,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/320ef761-bd02-47d6-b931-ef1f5cf97e6d_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-14',
 'seller_name': 'Hedin Automotive',
 'title': 'MERCEDES-BENZ GLA HATCHBACK GLA 200 AMG Line Premium 5dr Auto',
 'transmission': 'automatic',
 'trim': 'GLA 200 AMG Line Premium 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-01 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576078%27 HTTP/1.1" 200 None
2025-12-01 19:03:13 [astonbarclay.gb] INFO: Saving data for 117576078: {'created_time': 1764615793.473383, 'last_price_update_time': 1764615793.473394, 'auction_closing_time': 1764756000.0}
2025-12-01 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117576078') HTTP/1.1" 204 0
2025-12-01 19:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 91e3816c-1299-58c7-b5f9-71f70184e072 with identifier: 117583759
2025-12-01 19:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 91e3816c-1299-58c7-b5f9-71f70184e072 with identifier: 117583759
2025-12-01 19:03:13 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 91e3816c-1299-58c7-b5f9-71f70184e072 with identifier: 117583759 to the API
2025-12-01 19:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LB66AVM/2025-12-01/image/1edf8ba4-345d-4c2c-a13c-c588b2af83ce_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '91e3816c-1299-58c7-b5f9-71f70184e072',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LB66AVM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117583759',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '3 SERIES GRAN TURISMO DIESEL HATCHBACK',
 'odometer': 48944,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91e3816c-1299-58c7-b5f9-71f70184e072/91e3816c-1299-58c7-b5f9-71f70184e072_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33741,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/b387e301-c92b-44ff-b393-3ede44830b6d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91e3816c-1299-58c7-b5f9-71f70184e072/91e3816c-1299-58c7-b5f9-71f70184e072_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31244,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/1ee2b024-5002-4147-a8a5-1a6d9addde23_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91e3816c-1299-58c7-b5f9-71f70184e072/91e3816c-1299-58c7-b5f9-71f70184e072_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32580,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/059e3e4d-3359-4fb7-97b2-ec35a2823d89_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91e3816c-1299-58c7-b5f9-71f70184e072/91e3816c-1299-58c7-b5f9-71f70184e072_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31886,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/ca952cdc-1ef5-4030-b8ee-8ad926443e33_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91e3816c-1299-58c7-b5f9-71f70184e072/91e3816c-1299-58c7-b5f9-71f70184e072_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41580,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/c233feda-fb26-4c8f-9198-1b3402a634ca_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91e3816c-1299-58c7-b5f9-71f70184e072/91e3816c-1299-58c7-b5f9-71f70184e072_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45757,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/1edf8ba4-345d-4c2c-a13c-c588b2af83ce_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91e3816c-1299-58c7-b5f9-71f70184e072/91e3816c-1299-58c7-b5f9-71f70184e072_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50090,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/f917434e-1f34-4d80-9d4e-dc94bd53757e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91e3816c-1299-58c7-b5f9-71f70184e072/91e3816c-1299-58c7-b5f9-71f70184e072_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48624,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/09dd2531-a177-4090-b146-39b989553254_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91e3816c-1299-58c7-b5f9-71f70184e072/91e3816c-1299-58c7-b5f9-71f70184e072_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51048,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/3bad41e8-555c-4d01-9e08-c58d2065170f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91e3816c-1299-58c7-b5f9-71f70184e072/91e3816c-1299-58c7-b5f9-71f70184e072_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42982,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/eb36ef3d-ad39-4952-9e2f-d2cd6c843415_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-30',
 'seller_name': 'Hedin Automotive BMW',
 'title': 'BMW 3 SERIES GRAN TURISMO DIESEL HATCHBACK 335d xDrive M Sport 5dr '
          'Step Auto [Business Media]',
 'transmission': 'automatic',
 'trim': '335d xDrive M Sport 5dr Step Auto [Business Media]',
 'vin': None,
 'year': 2016}
2025-12-01 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117583759%27 HTTP/1.1" 200 None
2025-12-01 19:03:13 [astonbarclay.gb] INFO: Saving data for 117583759: {'created_time': 1764615793.879856, 'last_price_update_time': 1764615793.879866, 'auction_closing_time': 1764756000.0}
2025-12-01 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117583759') HTTP/1.1" 204 0
2025-12-01 19:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e744a10>
2025-12-01 19:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b82772-9067-5549-932e-76f41c49ba19/28b82772-9067-5549-932e-76f41c49ba19_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEO18JKK%252F2025-12-01%252Fimage%252F3f5ead84-988d-41cf-8cf5-0a15dfd879f5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EO18JKK/2025-12-01/image/3f5ead84-988d-41cf-8cf5-0a15dfd879f5_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 28b82772-9067-5549-932e-76f41c49ba19
2025-12-01 19:03:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 28b82772-9067-5549-932e-76f41c49ba19, skipping ID generation
2025-12-01 19:03:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28b82772-9067-5549-932e-76f41c49ba19 with scrape type 1
2025-12-01 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 28b82772-9067-5549-932e-76f41c49ba19 from tracking dictionaries
2025-12-01 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 28b82772-9067-5549-932e-76f41c49ba19 sending to next pipeline
2025-12-01 19:03:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 28b82772-9067-5549-932e-76f41c49ba19, identifier: 117627785
2025-12-01 19:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WL19RLV/2025-12-01/image/4d574f6b-6e0d-4c9c-b72c-426fe5c5e208_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117632563?view=catalogue)
2025-12-01 19:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AP74FTD/2025-11-21/image/e100cf27-028c-41a5-8b00-2a23162381fe_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117394487?view=catalogue)
2025-12-01 19:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/40fa855d-edee-4715-a329-508368f3efd2.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117610728?view=catalogue)
2025-12-01 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAP74FTD%252F2025-11-21%252Fimage%252Fda028012-3e27-4e83-bc3d-471d864f6ab2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP74FTD/2025-11-21/image/da028012-3e27-4e83-bc3d-471d864f6ab2_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLN73OFU%252F2025-11-27%252Fimage%252F921414e8-64e3-448b-a152-f2e85f71fb43_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN73OFU/2025-11-27/image/921414e8-64e3-448b-a152-f2e85f71fb43_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 28b82772-9067-5549-932e-76f41c49ba19 with identifier: 117627785
2025-12-01 19:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 28b82772-9067-5549-932e-76f41c49ba19 with identifier: 117627785
2025-12-01 19:03:14 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 28b82772-9067-5549-932e-76f41c49ba19 with identifier: 117627785 to the API
2025-12-01 19:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:03:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EO18JKK/2025-12-01/image/3f5ead84-988d-41cf-8cf5-0a15dfd879f5_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '28b82772-9067-5549-932e-76f41c49ba19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EO18JKK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117627785',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'CORSA HATCHBACK SPECIAL EDS',
 'odometer': 43837,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b82772-9067-5549-932e-76f41c49ba19/28b82772-9067-5549-932e-76f41c49ba19_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29117,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO18JKK/2025-12-01/image/27bdd94b-539b-43ec-8eb3-81352cde3a3c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b82772-9067-5549-932e-76f41c49ba19/28b82772-9067-5549-932e-76f41c49ba19_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28012,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO18JKK/2025-12-01/image/3c4691bd-fb61-462a-9086-21c16a0b53d6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b82772-9067-5549-932e-76f41c49ba19/28b82772-9067-5549-932e-76f41c49ba19_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29807,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO18JKK/2025-12-01/image/268e3f56-ac14-49f2-8157-af1c1f3fb1b2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b82772-9067-5549-932e-76f41c49ba19/28b82772-9067-5549-932e-76f41c49ba19_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27182,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO18JKK/2025-12-01/image/36deaa9e-ee8a-4a96-b565-1114285a10ec_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b82772-9067-5549-932e-76f41c49ba19/28b82772-9067-5549-932e-76f41c49ba19_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43464,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO18JKK/2025-12-01/image/32cc8eb7-bec7-4cd4-9227-a31ae252f49c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b82772-9067-5549-932e-76f41c49ba19/28b82772-9067-5549-932e-76f41c49ba19_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37582,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO18JKK/2025-12-01/image/b43f7eb7-bd59-43c4-932b-7aad6701dfd8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b82772-9067-5549-932e-76f41c49ba19/28b82772-9067-5549-932e-76f41c49ba19_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42034,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO18JKK/2025-12-01/image/874341f9-f211-491b-87ca-e9698be01f8e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b82772-9067-5549-932e-76f41c49ba19/28b82772-9067-5549-932e-76f41c49ba19_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48915,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EO18JKK/2025-12-01/image/3f5ead84-988d-41cf-8cf5-0a15dfd879f5_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-17',
 'seller_name': 'UKCGR',
 'title': 'VAUXHALL CORSA HATCHBACK SPECIAL EDS 1.4 [75] Energy 3dr [AC]',
 'transmission': 'manual',
 'trim': '1.4 [75] Energy 3dr [AC]',
 'vin': None,
 'year': 2018}
2025-12-01 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117627785%27 HTTP/1.1" 200 None
2025-12-01 19:03:14 [astonbarclay.gb] INFO: Saving data for 117627785: {'created_time': 1764615794.618659, 'last_price_update_time': 1764615794.618669}
2025-12-01 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117627785') HTTP/1.1" 204 0
2025-12-01 19:03:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e59bad0>
2025-12-01 19:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7553a85-b1d7-5800-8c41-acd80624ea68/c7553a85-b1d7-5800-8c41-acd80624ea68_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FET17TNV%252F2025-12-01%252Fimage%252F9af11aa6-f189-488f-8341-502ca7506746_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/ET17TNV/2025-12-01/image/9af11aa6-f189-488f-8341-502ca7506746_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c7553a85-b1d7-5800-8c41-acd80624ea68
2025-12-01 19:03:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7553a85-b1d7-5800-8c41-acd80624ea68, skipping ID generation
2025-12-01 19:03:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7553a85-b1d7-5800-8c41-acd80624ea68 with scrape type 1
2025-12-01 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c7553a85-b1d7-5800-8c41-acd80624ea68 from tracking dictionaries
2025-12-01 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c7553a85-b1d7-5800-8c41-acd80624ea68 sending to next pipeline
2025-12-01 19:03:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c7553a85-b1d7-5800-8c41-acd80624ea68, identifier: 117596913
2025-12-01 19:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e579e10>
2025-12-01 19:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41a9bad-985b-5457-94ae-8b214ecf4c78/a41a9bad-985b-5457-94ae-8b214ecf4c78_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FGC65DZW%252F2025-11-26%252Fimage%252Fa128af62-2e45-4fa6-8bf7-680f3eda5aa4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/GC65DZW/2025-11-26/image/a128af62-2e45-4fa6-8bf7-680f3eda5aa4_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a41a9bad-985b-5457-94ae-8b214ecf4c78
2025-12-01 19:03:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a41a9bad-985b-5457-94ae-8b214ecf4c78, skipping ID generation
2025-12-01 19:03:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a41a9bad-985b-5457-94ae-8b214ecf4c78 with scrape type 1
2025-12-01 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a41a9bad-985b-5457-94ae-8b214ecf4c78 from tracking dictionaries
2025-12-01 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a41a9bad-985b-5457-94ae-8b214ecf4c78 sending to next pipeline
2025-12-01 19:03:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a41a9bad-985b-5457-94ae-8b214ecf4c78, identifier: 117495142
2025-12-01 19:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LT74PGO/2025-11-21/image/ba76bcc3-8a4c-43f8-b0f0-616c1d383259_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117395964?view=catalogue)
2025-12-01 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLT74PGO%252F2025-11-21%252Fimage%252F3873d6cd-5063-4a36-9827-7b9cd03323a1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT74PGO/2025-11-21/image/3873d6cd-5063-4a36-9827-7b9cd03323a1_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c7553a85-b1d7-5800-8c41-acd80624ea68 with identifier: 117596913
2025-12-01 19:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c7553a85-b1d7-5800-8c41-acd80624ea68 with identifier: 117596913
2025-12-01 19:03:15 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c7553a85-b1d7-5800-8c41-acd80624ea68 with identifier: 117596913 to the API
2025-12-01 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:03:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/ET17TNV/2025-12-01/image/9af11aa6-f189-488f-8341-502ca7506746_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'c7553a85-b1d7-5800-8c41-acd80624ea68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'ET17TNV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117596913',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'S-MAX DIESEL ESTATE',
 'odometer': 79405,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7553a85-b1d7-5800-8c41-acd80624ea68/c7553a85-b1d7-5800-8c41-acd80624ea68_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35409,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ET17TNV/2025-12-01/image/c2749c85-11d6-4b3d-9254-e58ccdbd81e3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7553a85-b1d7-5800-8c41-acd80624ea68/c7553a85-b1d7-5800-8c41-acd80624ea68_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36263,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ET17TNV/2025-12-01/image/e658696e-fe29-4266-9d14-4fafc4234d58_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7553a85-b1d7-5800-8c41-acd80624ea68/c7553a85-b1d7-5800-8c41-acd80624ea68_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36111,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ET17TNV/2025-12-01/image/a23519b1-141a-489d-8ae3-066427c44f25_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7553a85-b1d7-5800-8c41-acd80624ea68/c7553a85-b1d7-5800-8c41-acd80624ea68_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35028,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ET17TNV/2025-12-01/image/5f65e192-02f6-46c1-86c7-b818124a8eca_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7553a85-b1d7-5800-8c41-acd80624ea68/c7553a85-b1d7-5800-8c41-acd80624ea68_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46107,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ET17TNV/2025-12-01/image/9af11aa6-f189-488f-8341-502ca7506746_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7553a85-b1d7-5800-8c41-acd80624ea68/c7553a85-b1d7-5800-8c41-acd80624ea68_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52436,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ET17TNV/2025-12-01/image/cdd6f396-36f2-47d7-875a-59e91c12d5ac_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7553a85-b1d7-5800-8c41-acd80624ea68/c7553a85-b1d7-5800-8c41-acd80624ea68_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46888,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ET17TNV/2025-12-01/image/008c7464-e0c0-4f44-9054-7f8ee27989ab_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7553a85-b1d7-5800-8c41-acd80624ea68/c7553a85-b1d7-5800-8c41-acd80624ea68_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55481,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ET17TNV/2025-12-01/image/8b12ae8d-d896-478d-aed8-d1600b6e77f3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7553a85-b1d7-5800-8c41-acd80624ea68/c7553a85-b1d7-5800-8c41-acd80624ea68_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45468,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/ET17TNV/2025-12-01/image/3049ae76-41a8-4209-834d-73f2b0dba9cc_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-30',
 'seller_name': 'SMC Group',
 'title': 'FORD S-MAX DIESEL ESTATE 2.0 TDCi 150 Titanium 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDCi 150 Titanium 5dr',
 'vin': None,
 'year': 2017}
2025-12-01 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117596913%27 HTTP/1.1" 200 None
2025-12-01 19:03:15 [astonbarclay.gb] INFO: Saving data for 117596913: {'created_time': 1764615795.690875, 'last_price_update_time': 1764615795.690886, 'auction_closing_time': 1764756000.0}
2025-12-01 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117596913') HTTP/1.1" 204 0
2025-12-01 19:03:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a41a9bad-985b-5457-94ae-8b214ecf4c78 with identifier: 117495142
2025-12-01 19:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a41a9bad-985b-5457-94ae-8b214ecf4c78 with identifier: 117495142
2025-12-01 19:03:15 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a41a9bad-985b-5457-94ae-8b214ecf4c78 with identifier: 117495142 to the API
2025-12-01 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:03:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/GC65DZW/2025-11-26/image/a128af62-2e45-4fa6-8bf7-680f3eda5aa4_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a41a9bad-985b-5457-94ae-8b214ecf4c78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GC65DZW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117495142',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'POLO HATCHBACK',
 'odometer': 85302,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41a9bad-985b-5457-94ae-8b214ecf4c78/a41a9bad-985b-5457-94ae-8b214ecf4c78_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32723,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GC65DZW/2025-11-26/image/2ad9e4a6-212a-4eb3-b8dd-1f3826fa4ac4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41a9bad-985b-5457-94ae-8b214ecf4c78/a41a9bad-985b-5457-94ae-8b214ecf4c78_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35603,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GC65DZW/2025-11-26/image/0aec4fc0-ccfe-45e3-8be1-16be96c04689_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41a9bad-985b-5457-94ae-8b214ecf4c78/a41a9bad-985b-5457-94ae-8b214ecf4c78_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34493,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GC65DZW/2025-11-26/image/a07d8dde-542c-4e65-a443-d6de9c812000_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41a9bad-985b-5457-94ae-8b214ecf4c78/a41a9bad-985b-5457-94ae-8b214ecf4c78_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32455,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GC65DZW/2025-11-26/image/ec6e9e30-66ba-4173-a850-9625294d9298_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41a9bad-985b-5457-94ae-8b214ecf4c78/a41a9bad-985b-5457-94ae-8b214ecf4c78_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57561,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GC65DZW/2025-11-26/image/a128af62-2e45-4fa6-8bf7-680f3eda5aa4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41a9bad-985b-5457-94ae-8b214ecf4c78/a41a9bad-985b-5457-94ae-8b214ecf4c78_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52713,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GC65DZW/2025-11-26/image/7d8543f3-be50-4ffd-865d-e8a9f8cb2578_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41a9bad-985b-5457-94ae-8b214ecf4c78/a41a9bad-985b-5457-94ae-8b214ecf4c78_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56887,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GC65DZW/2025-11-26/image/37d9c286-8ba9-40f0-88a3-efe5214b23c7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41a9bad-985b-5457-94ae-8b214ecf4c78/a41a9bad-985b-5457-94ae-8b214ecf4c78_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55675,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GC65DZW/2025-11-26/image/747a7451-dce7-4096-adb0-d6ee56a3f03d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a41a9bad-985b-5457-94ae-8b214ecf4c78/a41a9bad-985b-5457-94ae-8b214ecf4c78_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54017,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/GC65DZW/2025-11-26/image/56c53d51-1db8-49f3-8d86-3c2f63d13992_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-09',
 'seller_name': 'Autolend',
 'title': 'VOLKSWAGEN POLO HATCHBACK 1.2 TSI SE 5dr',
 'transmission': 'manual',
 'trim': '1.2 TSI SE 5dr',
 'vin': None,
 'year': 2016}
2025-12-01 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117495142%27 HTTP/1.1" 200 None
2025-12-01 19:03:16 [astonbarclay.gb] INFO: Saving data for 117495142: {'created_time': 1764615796.075586, 'last_price_update_time': 1764615796.075598, 'auction_closing_time': 1764756000.0}
2025-12-01 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117495142') HTTP/1.1" 204 0
2025-12-01 19:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e64f550>
2025-12-01 19:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fc61c1e-27fc-5109-8c11-3436b81e5022/6fc61c1e-27fc-5109-8c11-3436b81e5022_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDE17YWV%252F2025-12-01%252Fimage%252F02290c2b-fba6-4006-a1eb-be44ffc2f211_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DE17YWV/2025-12-01/image/02290c2b-fba6-4006-a1eb-be44ffc2f211_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6fc61c1e-27fc-5109-8c11-3436b81e5022
2025-12-01 19:03:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6fc61c1e-27fc-5109-8c11-3436b81e5022, skipping ID generation
2025-12-01 19:03:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fc61c1e-27fc-5109-8c11-3436b81e5022 with scrape type 1
2025-12-01 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6fc61c1e-27fc-5109-8c11-3436b81e5022 from tracking dictionaries
2025-12-01 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6fc61c1e-27fc-5109-8c11-3436b81e5022 sending to next pipeline
2025-12-01 19:03:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6fc61c1e-27fc-5109-8c11-3436b81e5022, identifier: 117636439
2025-12-01 19:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AP74FTD/2025-11-21/image/071fdd9e-b2f0-4ee5-92f3-5c36034febfd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117394487?view=catalogue)
2025-12-01 19:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/4202afd9-5436-49a3-aa7e-430b969a44ec.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117613099?view=catalogue)
2025-12-01 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAP74FTD%252F2025-11-21%252Fimage%252Fb130b72f-71c1-4c32-9e77-298a592c3f67_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP74FTD/2025-11-21/image/b130b72f-71c1-4c32-9e77-298a592c3f67_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLN73OFU%252F2025-11-27%252Fimage%252Fb3bd0ada-53fe-47b8-a0ce-b3eaf660abbb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN73OFU/2025-11-27/image/b3bd0ada-53fe-47b8-a0ce-b3eaf660abbb_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6fc61c1e-27fc-5109-8c11-3436b81e5022 with identifier: 117636439
2025-12-01 19:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6fc61c1e-27fc-5109-8c11-3436b81e5022 with identifier: 117636439
2025-12-01 19:03:16 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6fc61c1e-27fc-5109-8c11-3436b81e5022 with identifier: 117636439 to the API
2025-12-01 19:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:03:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DE17YWV/2025-12-01/image/02290c2b-fba6-4006-a1eb-be44ffc2f211_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-02T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '6fc61c1e-27fc-5109-8c11-3436b81e5022',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DE17YWV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117636439',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'KIA',
 'model': 'SPORTAGE ESTATE',
 'odometer': 70290,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fc61c1e-27fc-5109-8c11-3436b81e5022/6fc61c1e-27fc-5109-8c11-3436b81e5022_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34506,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DE17YWV/2025-12-01/image/02290c2b-fba6-4006-a1eb-be44ffc2f211_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fc61c1e-27fc-5109-8c11-3436b81e5022/6fc61c1e-27fc-5109-8c11-3436b81e5022_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35153,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DE17YWV/2025-12-01/image/c78ece7c-8885-46ad-ad9f-c930ca8c36cf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fc61c1e-27fc-5109-8c11-3436b81e5022/6fc61c1e-27fc-5109-8c11-3436b81e5022_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34121,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DE17YWV/2025-12-01/image/983b7f49-2ec0-4f09-88d7-6da5e9dd26d8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fc61c1e-27fc-5109-8c11-3436b81e5022/6fc61c1e-27fc-5109-8c11-3436b81e5022_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32874,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DE17YWV/2025-12-01/image/43ceb04c-2be2-45c9-bdd8-7e129924f0b1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fc61c1e-27fc-5109-8c11-3436b81e5022/6fc61c1e-27fc-5109-8c11-3436b81e5022_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45526,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DE17YWV/2025-12-01/image/cd7be7de-093c-4c2d-a0f6-104567d25a66_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fc61c1e-27fc-5109-8c11-3436b81e5022/6fc61c1e-27fc-5109-8c11-3436b81e5022_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55356,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DE17YWV/2025-12-01/image/ceac24e4-53c0-48f2-be99-91fb0dc82a3b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fc61c1e-27fc-5109-8c11-3436b81e5022/6fc61c1e-27fc-5109-8c11-3436b81e5022_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44358,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DE17YWV/2025-12-01/image/f1b9b5b3-b66a-409c-8624-6d465ff90acf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fc61c1e-27fc-5109-8c11-3436b81e5022/6fc61c1e-27fc-5109-8c11-3436b81e5022_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46380,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DE17YWV/2025-12-01/image/67195d9c-b82b-45ce-b970-38ec4af90eae_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fc61c1e-27fc-5109-8c11-3436b81e5022/6fc61c1e-27fc-5109-8c11-3436b81e5022_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51215,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DE17YWV/2025-12-01/image/3e549e1c-5ec9-4d0c-b2d1-329320697f86_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-31',
 'seller_name': 'Dace',
 'title': 'KIA SPORTAGE ESTATE 1.6 GDi ISG 2 5dr',
 'transmission': 'manual',
 'trim': '1.6 GDi ISG 2 5dr',
 'vin': None,
 'year': 2017}
2025-12-01 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117636439%27 HTTP/1.1" 200 None
2025-12-01 19:03:16 [astonbarclay.gb] INFO: Saving data for 117636439: {'created_time': 1764615796.909137, 'last_price_update_time': 1764615796.909153, 'auction_closing_time': 1764669600.0}
2025-12-01 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117636439') HTTP/1.1" 204 0
2025-12-01 19:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e67af10>
2025-12-01 19:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315a462f-b1fb-5767-99b3-d3e45f95653b/315a462f-b1fb-5767-99b3-d3e45f95653b_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWL19RLV%252F2025-12-01%252Fimage%252Faf3fc48b-79a9-46a1-a39f-3f4904e08f5d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WL19RLV/2025-12-01/image/af3fc48b-79a9-46a1-a39f-3f4904e08f5d_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 315a462f-b1fb-5767-99b3-d3e45f95653b
2025-12-01 19:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e7d2810>
2025-12-01 19:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6ff7ec9-3cc9-5036-b785-6abff98081d3/a6ff7ec9-3cc9-5036-b785-6abff98081d3_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLT74PGO%252F2025-11-21%252Fimage%252Ffc78be48-d16a-4b51-ba5f-462c2fc036cc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT74PGO/2025-11-21/image/fc78be48-d16a-4b51-ba5f-462c2fc036cc_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a6ff7ec9-3cc9-5036-b785-6abff98081d3
2025-12-01 19:03:17 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117415829, 'registration': 'LN74OYX', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE', 'derivative': '210kW Match Pro 77kWh 5dr Auto', 'mileage': 16458, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-12-12', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LN74OYX/2025-11-21/image/7ba24871-2e5a-429b-9687-b74eae7434b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/0fde4743-98cb-4b3a-8d50-3304d420ab80_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/17c67160-5a92-4b68-803c-a35b8458a4e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/327c4776-009a-4e39-9e86-72d89206f227_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/e93add83-58a4-49db-a2ca-00d5196bc0cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/c0e0bc52-b7c5-431d-bc79-90b76400df49_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/9f80509d-ef47-42e4-aa07-c83131fa59d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/cd47c374-aae7-4084-811f-d9d2a02f5b56_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/e52f3cee-3364-4d4f-86b3-c087cb6158b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/ca13aae3-8ad7-4469-bf3b-38b3608d4150_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/564cce15-2e8b-4452-9b14-23c2873f02c4.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:17 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117415829, 'registration': 'LN74OYX', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'ID.4 ESTATE', 'derivative': '210kW Match Pro 77kWh 5dr Auto', 'mileage': 16458, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-12-12', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LN74OYX/2025-11-21/image/7ba24871-2e5a-429b-9687-b74eae7434b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/0fde4743-98cb-4b3a-8d50-3304d420ab80_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/17c67160-5a92-4b68-803c-a35b8458a4e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/327c4776-009a-4e39-9e86-72d89206f227_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/e93add83-58a4-49db-a2ca-00d5196bc0cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/c0e0bc52-b7c5-431d-bc79-90b76400df49_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/9f80509d-ef47-42e4-aa07-c83131fa59d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/cd47c374-aae7-4084-811f-d9d2a02f5b56_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/e52f3cee-3364-4d4f-86b3-c087cb6158b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/ca13aae3-8ad7-4469-bf3b-38b3608d4150_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/564cce15-2e8b-4452-9b14-23c2873f02c4.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33d7290d-cc06-57b8-b4b5-7609a19c2a74 with identifier: 117415829
2025-12-01 19:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33d7290d-cc06-57b8-b4b5-7609a19c2a74 with scrape type 1
2025-12-01 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 33d7290d-cc06-57b8-b4b5-7609a19c2a74
2025-12-01 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLN74OYX%252F2025-11-21%252Fimage%252F7ba24871-2e5a-429b-9687-b74eae7434b6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN74OYX/2025-11-21/image/7ba24871-2e5a-429b-9687-b74eae7434b6_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA19YRV/2025-12-01/image/fedeaa24-2acb-49a3-a2aa-22d55c64d143_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117621114?view=catalogue)
2025-12-01 19:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LT74PGO/2025-11-21/image/5fd5ef5a-fab7-42ae-9738-5351c6cc472f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117395964?view=catalogue)
2025-12-01 19:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/eb04432f-dee8-467c-b612-a613fd17f291.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117610728?view=catalogue)
2025-12-01 19:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/073c8542-5c64-4b04-a9da-f42144a1caa8.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117613099?view=catalogue)
2025-12-01 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLT74PGO%252F2025-11-21%252Fimage%252F750b4384-eafe-48a6-9ee1-51482c8077a4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT74PGO/2025-11-21/image/750b4384-eafe-48a6-9ee1-51482c8077a4_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117585575?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e8c28d0>
2025-12-01 19:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315a462f-b1fb-5767-99b3-d3e45f95653b/315a462f-b1fb-5767-99b3-d3e45f95653b_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWL19RLV%252F2025-12-01%252Fimage%252F4d574f6b-6e0d-4c9c-b72c-426fe5c5e208_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WL19RLV/2025-12-01/image/4d574f6b-6e0d-4c9c-b72c-426fe5c5e208_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 315a462f-b1fb-5767-99b3-d3e45f95653b
2025-12-01 19:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f39db90>
2025-12-01 19:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee9ea4a-1d35-54dd-ac37-06a67c77e6ec/aee9ea4a-1d35-54dd-ac37-06a67c77e6ec_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAP74FTD%252F2025-11-21%252Fimage%252Fe100cf27-028c-41a5-8b00-2a23162381fe_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP74FTD/2025-11-21/image/e100cf27-028c-41a5-8b00-2a23162381fe_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aee9ea4a-1d35-54dd-ac37-06a67c77e6ec
2025-12-01 19:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e681dd0>
2025-12-01 19:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4471d1-1330-5f18-bc6b-f50165d7cebc/9b4471d1-1330-5f18-bc6b-f50165d7cebc_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F40fa855d-edee-4715-a329-508368f3efd2.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/40fa855d-edee-4715-a329-508368f3efd2.jpg?w=600 saved to cache
2025-12-01 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b4471d1-1330-5f18-bc6b-f50165d7cebc
2025-12-01 19:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LT74PGO/2025-11-21/image/e4d68599-532a-4bbe-884f-f4a88f9ac699_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117395964?view=catalogue)
2025-12-01 19:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/WL19RLV/2025-12-01/image/eb9b8c35-4d6f-4147-ad12-5cabec422197_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117632563?view=catalogue)
2025-12-01 19:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LN73OFU/2025-11-27/image/78f7c909-3bf2-4c31-aaf7-b56b4f56787a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117492820?view=catalogue)
2025-12-01 19:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AP74FTD/2025-11-21/image/01f5b861-641a-4d01-96fa-d725b39b2f1a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117394487?view=catalogue)
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAP74FTD%252F2025-11-21%252Fimage%252Fbe9f1ba6-ef7e-4818-abb3-cd4c4f0958d1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP74FTD/2025-11-21/image/be9f1ba6-ef7e-4818-abb3-cd4c4f0958d1_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLN73OFU%252F2025-11-27%252Fimage%252Fbe2d3a6c-129c-4222-a0a2-8ea76016b1a9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN73OFU/2025-11-27/image/be2d3a6c-129c-4222-a0a2-8ea76016b1a9_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLN74OYX%252F2025-11-21%252Fimage%252F0fde4743-98cb-4b3a-8d50-3304d420ab80_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN74OYX/2025-11-21/image/0fde4743-98cb-4b3a-8d50-3304d420ab80_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e9f5e10>
2025-12-01 19:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6ff7ec9-3cc9-5036-b785-6abff98081d3/a6ff7ec9-3cc9-5036-b785-6abff98081d3_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLT74PGO%252F2025-11-21%252Fimage%252Fba76bcc3-8a4c-43f8-b0f0-616c1d383259_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT74PGO/2025-11-21/image/ba76bcc3-8a4c-43f8-b0f0-616c1d383259_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a6ff7ec9-3cc9-5036-b785-6abff98081d3
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLT74PGO%252F2025-11-21%252Fimage%252Ff63042ba-0c73-4d2b-a2ed-e278b8e2b06f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT74PGO/2025-11-21/image/f63042ba-0c73-4d2b-a2ed-e278b8e2b06f_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117418998?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e68bf50>
2025-12-01 19:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee9ea4a-1d35-54dd-ac37-06a67c77e6ec/aee9ea4a-1d35-54dd-ac37-06a67c77e6ec_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAP74FTD%252F2025-11-21%252Fimage%252F071fdd9e-b2f0-4ee5-92f3-5c36034febfd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP74FTD/2025-11-21/image/071fdd9e-b2f0-4ee5-92f3-5c36034febfd_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aee9ea4a-1d35-54dd-ac37-06a67c77e6ec
2025-12-01 19:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f2e8510>
2025-12-01 19:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d743ca24-9736-56bb-8379-98c4ba2e7cf2/d743ca24-9736-56bb-8379-98c4ba2e7cf2_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F4202afd9-5436-49a3-aa7e-430b969a44ec.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/4202afd9-5436-49a3-aa7e-430b969a44ec.jpg?w=600 saved to cache
2025-12-01 19:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d743ca24-9736-56bb-8379-98c4ba2e7cf2
2025-12-01 19:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LN73OFU/2025-11-27/image/921414e8-64e3-448b-a152-f2e85f71fb43_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117492820?view=catalogue)
2025-12-01 19:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AP74FTD/2025-11-21/image/da028012-3e27-4e83-bc3d-471d864f6ab2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117394487?view=catalogue)
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAP74FTD%252F2025-11-21%252Fimage%252Fa5ff6f6f-ec51-4f61-9b17-11d20da18da4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP74FTD/2025-11-21/image/a5ff6f6f-ec51-4f61-9b17-11d20da18da4_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLN73OFU%252F2025-11-27%252Fimage%252F996933d0-7acf-45f9-b2db-93487c637ed8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN73OFU/2025-11-27/image/996933d0-7acf-45f9-b2db-93487c637ed8_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLN74OYX%252F2025-11-21%252Fimage%252F17c67160-5a92-4b68-803c-a35b8458a4e5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN74OYX/2025-11-21/image/17c67160-5a92-4b68-803c-a35b8458a4e5_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f2d4d90>
2025-12-01 19:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89214aa6-43de-5869-9911-0711c93784fc/89214aa6-43de-5869-9911-0711c93784fc_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA19YRV%252F2025-12-01%252Fimage%252Ffedeaa24-2acb-49a3-a2aa-22d55c64d143_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA19YRV/2025-12-01/image/fedeaa24-2acb-49a3-a2aa-22d55c64d143_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89214aa6-43de-5869-9911-0711c93784fc
2025-12-01 19:03:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89214aa6-43de-5869-9911-0711c93784fc, skipping ID generation
2025-12-01 19:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89214aa6-43de-5869-9911-0711c93784fc with scrape type 1
2025-12-01 19:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 89214aa6-43de-5869-9911-0711c93784fc from tracking dictionaries
2025-12-01 19:03:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89214aa6-43de-5869-9911-0711c93784fc sending to next pipeline
2025-12-01 19:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 89214aa6-43de-5869-9911-0711c93784fc, identifier: 117621114
2025-12-01 19:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f229510>
2025-12-01 19:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6ff7ec9-3cc9-5036-b785-6abff98081d3/a6ff7ec9-3cc9-5036-b785-6abff98081d3_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLT74PGO%252F2025-11-21%252Fimage%252F5fd5ef5a-fab7-42ae-9738-5351c6cc472f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT74PGO/2025-11-21/image/5fd5ef5a-fab7-42ae-9738-5351c6cc472f_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a6ff7ec9-3cc9-5036-b785-6abff98081d3
2025-12-01 19:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e8c45d0>
2025-12-01 19:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4471d1-1330-5f18-bc6b-f50165d7cebc/9b4471d1-1330-5f18-bc6b-f50165d7cebc_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Feb04432f-dee8-467c-b612-a613fd17f291.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/eb04432f-dee8-467c-b612-a613fd17f291.jpg?w=600 saved to cache
2025-12-01 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b4471d1-1330-5f18-bc6b-f50165d7cebc
2025-12-01 19:03:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b4471d1-1330-5f18-bc6b-f50165d7cebc, skipping ID generation
2025-12-01 19:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b4471d1-1330-5f18-bc6b-f50165d7cebc with scrape type 1
2025-12-01 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9b4471d1-1330-5f18-bc6b-f50165d7cebc from tracking dictionaries
2025-12-01 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b4471d1-1330-5f18-bc6b-f50165d7cebc sending to next pipeline
2025-12-01 19:03:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9b4471d1-1330-5f18-bc6b-f50165d7cebc, identifier: 117610728
2025-12-01 19:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f50648105d0>
2025-12-01 19:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d743ca24-9736-56bb-8379-98c4ba2e7cf2/d743ca24-9736-56bb-8379-98c4ba2e7cf2_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F073c8542-5c64-4b04-a9da-f42144a1caa8.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/073c8542-5c64-4b04-a9da-f42144a1caa8.jpg?w=600 saved to cache
2025-12-01 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d743ca24-9736-56bb-8379-98c4ba2e7cf2
2025-12-01 19:03:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d743ca24-9736-56bb-8379-98c4ba2e7cf2, skipping ID generation
2025-12-01 19:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d743ca24-9736-56bb-8379-98c4ba2e7cf2 with scrape type 1
2025-12-01 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d743ca24-9736-56bb-8379-98c4ba2e7cf2 from tracking dictionaries
2025-12-01 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d743ca24-9736-56bb-8379-98c4ba2e7cf2 sending to next pipeline
2025-12-01 19:03:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d743ca24-9736-56bb-8379-98c4ba2e7cf2, identifier: 117613099
2025-12-01 19:03:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117585575, 'registration': 'AJ18ANJ', 'account': 'STE093', 'make': 'BMW', 'model': 'X1 DIESEL ESTATE', 'derivative': 'xDrive 20d M Sport 5dr Step Auto', 'mileage': 41013, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-06-12', 'fuel': 'Diesel', 'motExpiry': '2026-11-18', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': ['https://abimg002.imgix.net/ad78b1f2-6c91-4c1d-803a-6f5f1bcea517.jpg?w=600', 'https://abimg002.imgix.net/4978e3b9-fe84-47ef-820b-e5907cb5c9d6.jpg?w=600', 'https://abimg002.imgix.net/50763228-ed37-4fc6-bb14-9272756ad2c5.jpg?w=600', 'https://abimg002.imgix.net/d55e6883-e641-4115-b07c-237bd61708f5.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5483cb7e-e2a6-4b93-ad13-4abb28208969.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117585575, 'registration': 'AJ18ANJ', 'account': 'STE093', 'make': 'BMW', 'model': 'X1 DIESEL ESTATE', 'derivative': 'xDrive 20d M Sport 5dr Step Auto', 'mileage': 41013, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2018-06-12', 'fuel': 'Diesel', 'motExpiry': '2026-11-18', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': ['https://abimg002.imgix.net/ad78b1f2-6c91-4c1d-803a-6f5f1bcea517.jpg?w=600', 'https://abimg002.imgix.net/4978e3b9-fe84-47ef-820b-e5907cb5c9d6.jpg?w=600', 'https://abimg002.imgix.net/50763228-ed37-4fc6-bb14-9272756ad2c5.jpg?w=600', 'https://abimg002.imgix.net/d55e6883-e641-4115-b07c-237bd61708f5.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5483cb7e-e2a6-4b93-ad13-4abb28208969.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbb00730-a35e-55f9-b961-ea273271c11d with identifier: 117585575
2025-12-01 19:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbb00730-a35e-55f9-b961-ea273271c11d with scrape type 1
2025-12-01 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item cbb00730-a35e-55f9-b961-ea273271c11d
2025-12-01 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fad78b1f2-6c91-4c1d-803a-6f5f1bcea517.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/ad78b1f2-6c91-4c1d-803a-6f5f1bcea517.jpg?w=600 not downloaded yet
2025-12-01 19:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LT74PGO/2025-11-21/image/3873d6cd-5063-4a36-9827-7b9cd03323a1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117395964?view=catalogue)
2025-12-01 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLT74PGO%252F2025-11-21%252Fimage%252F91017f22-9fea-4e74-b8e8-8a1b002cbc9a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT74PGO/2025-11-21/image/91017f22-9fea-4e74-b8e8-8a1b002cbc9a_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117348031?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:03:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 89214aa6-43de-5869-9911-0711c93784fc with identifier: 117621114
2025-12-01 19:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 89214aa6-43de-5869-9911-0711c93784fc with identifier: 117621114
2025-12-01 19:03:20 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 89214aa6-43de-5869-9911-0711c93784fc with expiration date: 2025-12-01T17:30:00Z
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-01T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': '89214aa6-43de-5869-9911-0711c93784fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EA19YRV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117621114',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'HYUNDAI',
 'model': 'I10 HATCHBACK',
 'odometer': 73975,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89214aa6-43de-5869-9911-0711c93784fc/89214aa6-43de-5869-9911-0711c93784fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35938,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA19YRV/2025-12-01/image/fedeaa24-2acb-49a3-a2aa-22d55c64d143_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89214aa6-43de-5869-9911-0711c93784fc/89214aa6-43de-5869-9911-0711c93784fc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38656,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA19YRV/2025-12-01/image/2201c716-4048-4559-b8f5-7cd42535a183_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89214aa6-43de-5869-9911-0711c93784fc/89214aa6-43de-5869-9911-0711c93784fc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35265,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA19YRV/2025-12-01/image/4a1c666f-01a8-405c-9dc2-d49f862447aa_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89214aa6-43de-5869-9911-0711c93784fc/89214aa6-43de-5869-9911-0711c93784fc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35090,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA19YRV/2025-12-01/image/c4ec43eb-d5cb-456b-aee2-a3ffe38f099f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89214aa6-43de-5869-9911-0711c93784fc/89214aa6-43de-5869-9911-0711c93784fc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49579,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA19YRV/2025-12-01/image/b75c6da1-844f-4784-bf20-81735ae1911d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89214aa6-43de-5869-9911-0711c93784fc/89214aa6-43de-5869-9911-0711c93784fc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40469,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA19YRV/2025-12-01/image/6bbaf1fb-75ea-4a14-b4ed-06bf0498a82f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89214aa6-43de-5869-9911-0711c93784fc/89214aa6-43de-5869-9911-0711c93784fc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50533,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA19YRV/2025-12-01/image/b99607bd-63b7-4065-a0c5-dda5e31dee44_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89214aa6-43de-5869-9911-0711c93784fc/89214aa6-43de-5869-9911-0711c93784fc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42896,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA19YRV/2025-12-01/image/37233342-b6c1-4aae-9ee9-2ffe6be1a099_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89214aa6-43de-5869-9911-0711c93784fc/89214aa6-43de-5869-9911-0711c93784fc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53677,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA19YRV/2025-12-01/image/a8860e8a-3fb3-4c6e-93b3-dabae7aef4b9_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-12',
 'seller_name': 'CarGiant',
 'title': 'HYUNDAI I10 HATCHBACK 1.2 SE 5dr',
 'transmission': 'manual',
 'trim': '1.2 SE 5dr',
 'vin': None,
 'year': 2019}
2025-12-01 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117621114%27 HTTP/1.1" 200 None
2025-12-01 19:03:20 [astonbarclay.gb] INFO: Saving data for 117621114: {'created_time': 1764615800.774573, 'last_price_update_time': 1764615800.774581, 'auction_closing_time': 1764610200.0}
2025-12-01 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117621114') HTTP/1.1" 204 0
2025-12-01 19:03:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9b4471d1-1330-5f18-bc6b-f50165d7cebc with identifier: 117610728
2025-12-01 19:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9b4471d1-1330-5f18-bc6b-f50165d7cebc with identifier: 117610728
2025-12-01 19:03:20 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9b4471d1-1330-5f18-bc6b-f50165d7cebc with identifier: 117610728 to the API
2025-12-01 19:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/eb04432f-dee8-467c-b612-a613fd17f291.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.4L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '9b4471d1-1330-5f18-bc6b-f50165d7cebc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KP67NPA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117610728',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLVO',
 'model': 'XC60 DIESEL ESTATE',
 'odometer': 53987,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4471d1-1330-5f18-bc6b-f50165d7cebc/9b4471d1-1330-5f18-bc6b-f50165d7cebc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76293,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/eb04432f-dee8-467c-b612-a613fd17f291.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4471d1-1330-5f18-bc6b-f50165d7cebc/9b4471d1-1330-5f18-bc6b-f50165d7cebc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74197,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/299edf6b-fd89-4b09-bc7b-cbbca3dae92f.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4471d1-1330-5f18-bc6b-f50165d7cebc/9b4471d1-1330-5f18-bc6b-f50165d7cebc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76413,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/c207063b-b49b-46dd-8a34-9869f84ae358.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4471d1-1330-5f18-bc6b-f50165d7cebc/9b4471d1-1330-5f18-bc6b-f50165d7cebc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69909,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/5978d2fc-d80a-4fb9-b6c2-3eba4b955fd7.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4471d1-1330-5f18-bc6b-f50165d7cebc/9b4471d1-1330-5f18-bc6b-f50165d7cebc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85778,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/40fa855d-edee-4715-a329-508368f3efd2.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4471d1-1330-5f18-bc6b-f50165d7cebc/9b4471d1-1330-5f18-bc6b-f50165d7cebc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86311,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/abe328a8-429f-4c12-ad80-e4e148c48679.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4471d1-1330-5f18-bc6b-f50165d7cebc/9b4471d1-1330-5f18-bc6b-f50165d7cebc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96760,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/328bf1f9-5cfb-446e-b07d-5962f453a871.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4471d1-1330-5f18-bc6b-f50165d7cebc/9b4471d1-1330-5f18-bc6b-f50165d7cebc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81557,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/a09ffd85-aa9c-4794-a662-3a2a796086de.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4471d1-1330-5f18-bc6b-f50165d7cebc/9b4471d1-1330-5f18-bc6b-f50165d7cebc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75715,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/eb66f7d8-e6e2-4fbc-9292-1f064c93c791.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4471d1-1330-5f18-bc6b-f50165d7cebc/9b4471d1-1330-5f18-bc6b-f50165d7cebc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28610,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/650216a1-c723-4e6d-94d7-f75a778e1e9f.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4471d1-1330-5f18-bc6b-f50165d7cebc/9b4471d1-1330-5f18-bc6b-f50165d7cebc_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44759,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/e68f76e3-5134-4041-abe5-4fef8c59ae05.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4471d1-1330-5f18-bc6b-f50165d7cebc/9b4471d1-1330-5f18-bc6b-f50165d7cebc_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69963,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/cdccb1ad-e1d6-4201-aa56-dac4693cb326.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-29',
 'seller_name': 'Vantage Motor Group',
 'title': 'VOLVO XC60 DIESEL ESTATE D4 [190] R DESIGN Lux Nav 5dr AWD '
          'Geartronic',
 'transmission': 'automatic',
 'trim': 'D4 [190] R DESIGN Lux Nav 5dr AWD Geartronic',
 'vin': None,
 'year': 2017}
2025-12-01 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117610728%27 HTTP/1.1" 200 None
2025-12-01 19:03:21 [astonbarclay.gb] INFO: Saving data for 117610728: {'created_time': 1764615801.133145, 'last_price_update_time': 1764615801.133156, 'auction_closing_time': 1765285200.0}
2025-12-01 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117610728') HTTP/1.1" 204 0
2025-12-01 19:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d743ca24-9736-56bb-8379-98c4ba2e7cf2 with identifier: 117613099
2025-12-01 19:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d743ca24-9736-56bb-8379-98c4ba2e7cf2 with identifier: 117613099
2025-12-01 19:03:21 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d743ca24-9736-56bb-8379-98c4ba2e7cf2 with identifier: 117613099 to the API
2025-12-01 19:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/073c8542-5c64-4b04-a9da-f42144a1caa8.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'd743ca24-9736-56bb-8379-98c4ba2e7cf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MT68EBF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117613099',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'NISSAN',
 'model': 'MICRA HATCHBACK',
 'odometer': 40364,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d743ca24-9736-56bb-8379-98c4ba2e7cf2/d743ca24-9736-56bb-8379-98c4ba2e7cf2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78519,
             'Height': 442,
             'OriginUrl': 'https://abimg002.imgix.net/073c8542-5c64-4b04-a9da-f42144a1caa8.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d743ca24-9736-56bb-8379-98c4ba2e7cf2/d743ca24-9736-56bb-8379-98c4ba2e7cf2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73916,
             'Height': 442,
             'OriginUrl': 'https://abimg002.imgix.net/4202afd9-5436-49a3-aa7e-430b969a44ec.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d743ca24-9736-56bb-8379-98c4ba2e7cf2/d743ca24-9736-56bb-8379-98c4ba2e7cf2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60184,
             'Height': 442,
             'OriginUrl': 'https://abimg002.imgix.net/322fb60e-126d-4a01-a866-9bc740d566ab.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d743ca24-9736-56bb-8379-98c4ba2e7cf2/d743ca24-9736-56bb-8379-98c4ba2e7cf2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54225,
             'Height': 442,
             'OriginUrl': 'https://abimg002.imgix.net/287e56cf-7f7b-49e4-a42a-db3aae2172ea.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-10',
 'seller_name': 'Vantage Motor Group',
 'title': 'NISSAN MICRA HATCHBACK 0.9 IG-T N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '0.9 IG-T N-Connecta 5dr',
 'vin': None,
 'year': 2018}
2025-12-01 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117613099%27 HTTP/1.1" 200 None
2025-12-01 19:03:21 [astonbarclay.gb] INFO: Saving data for 117613099: {'created_time': 1764615801.479927, 'last_price_update_time': 1764615801.479937, 'auction_closing_time': 1765285200.0}
2025-12-01 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117613099') HTTP/1.1" 204 0
2025-12-01 19:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e7da550>
2025-12-01 19:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6ff7ec9-3cc9-5036-b785-6abff98081d3/a6ff7ec9-3cc9-5036-b785-6abff98081d3_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLT74PGO%252F2025-11-21%252Fimage%252Fe4d68599-532a-4bbe-884f-f4a88f9ac699_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT74PGO/2025-11-21/image/e4d68599-532a-4bbe-884f-f4a88f9ac699_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a6ff7ec9-3cc9-5036-b785-6abff98081d3
2025-12-01 19:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f3dd5d0>
2025-12-01 19:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315a462f-b1fb-5767-99b3-d3e45f95653b/315a462f-b1fb-5767-99b3-d3e45f95653b_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FWL19RLV%252F2025-12-01%252Fimage%252Feb9b8c35-4d6f-4147-ad12-5cabec422197_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/WL19RLV/2025-12-01/image/eb9b8c35-4d6f-4147-ad12-5cabec422197_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 315a462f-b1fb-5767-99b3-d3e45f95653b
2025-12-01 19:03:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 315a462f-b1fb-5767-99b3-d3e45f95653b, skipping ID generation
2025-12-01 19:03:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 315a462f-b1fb-5767-99b3-d3e45f95653b with scrape type 1
2025-12-01 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 315a462f-b1fb-5767-99b3-d3e45f95653b from tracking dictionaries
2025-12-01 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 315a462f-b1fb-5767-99b3-d3e45f95653b sending to next pipeline
2025-12-01 19:03:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 315a462f-b1fb-5767-99b3-d3e45f95653b, identifier: 117632563
2025-12-01 19:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f39e7d0>
2025-12-01 19:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b4c2d7-187b-5876-a316-a5afbbcf6cdf/f2b4c2d7-187b-5876-a316-a5afbbcf6cdf_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLN73OFU%252F2025-11-27%252Fimage%252F78f7c909-3bf2-4c31-aaf7-b56b4f56787a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN73OFU/2025-11-27/image/78f7c909-3bf2-4c31-aaf7-b56b4f56787a_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2b4c2d7-187b-5876-a316-a5afbbcf6cdf
2025-12-01 19:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e66e7d0>
2025-12-01 19:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee9ea4a-1d35-54dd-ac37-06a67c77e6ec/aee9ea4a-1d35-54dd-ac37-06a67c77e6ec_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAP74FTD%252F2025-11-21%252Fimage%252F01f5b861-641a-4d01-96fa-d725b39b2f1a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP74FTD/2025-11-21/image/01f5b861-641a-4d01-96fa-d725b39b2f1a_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aee9ea4a-1d35-54dd-ac37-06a67c77e6ec
2025-12-01 19:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LN73OFU/2025-11-27/image/b3bd0ada-53fe-47b8-a0ce-b3eaf660abbb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117492820?view=catalogue)
2025-12-01 19:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LN74OYX/2025-11-21/image/7ba24871-2e5a-429b-9687-b74eae7434b6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117415829?view=catalogue)
2025-12-01 19:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AP74FTD/2025-11-21/image/b130b72f-71c1-4c32-9e77-298a592c3f67_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117394487?view=catalogue)
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAP74FTD%252F2025-11-21%252Fimage%252Fcbba9733-326e-48d6-aabc-83083fdfab0d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP74FTD/2025-11-21/image/cbba9733-326e-48d6-aabc-83083fdfab0d_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLN73OFU%252F2025-11-27%252Fimage%252F20c329c2-4789-4011-9437-56b7d16d0930_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN73OFU/2025-11-27/image/20c329c2-4789-4011-9437-56b7d16d0930_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLN74OYX%252F2025-11-21%252Fimage%252F327c4776-009a-4e39-9e86-72d89206f227_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN74OYX/2025-11-21/image/327c4776-009a-4e39-9e86-72d89206f227_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F4978e3b9-fe84-47ef-820b-e5907cb5c9d6.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/4978e3b9-fe84-47ef-820b-e5907cb5c9d6.jpg?w=600 not downloaded yet
2025-12-01 19:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117563683?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:03:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 315a462f-b1fb-5767-99b3-d3e45f95653b with identifier: 117632563
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=YELLOW HTTP/1.1" 200 None
2025-12-01 19:03:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-01 19:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 315a462f-b1fb-5767-99b3-d3e45f95653b with identifier: 117632563
2025-12-01 19:03:22 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 315a462f-b1fb-5767-99b3-d3e45f95653b with expiration date: 2025-12-01T17:30:00Z
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'YELLOW',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-01T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': '315a462f-b1fb-5767-99b3-d3e45f95653b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WL19RLV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117632563',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MG MOTOR UK',
 'model': 'MG3 HATCHBACK',
 'odometer': 42899,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315a462f-b1fb-5767-99b3-d3e45f95653b/315a462f-b1fb-5767-99b3-d3e45f95653b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34703,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/eb9b8c35-4d6f-4147-ad12-5cabec422197_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315a462f-b1fb-5767-99b3-d3e45f95653b/315a462f-b1fb-5767-99b3-d3e45f95653b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35156,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/d2a24375-171e-4501-8a81-8a55efa8c542_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315a462f-b1fb-5767-99b3-d3e45f95653b/315a462f-b1fb-5767-99b3-d3e45f95653b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32316,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/4d574f6b-6e0d-4c9c-b72c-426fe5c5e208_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315a462f-b1fb-5767-99b3-d3e45f95653b/315a462f-b1fb-5767-99b3-d3e45f95653b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29833,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/af3fc48b-79a9-46a1-a39f-3f4904e08f5d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315a462f-b1fb-5767-99b3-d3e45f95653b/315a462f-b1fb-5767-99b3-d3e45f95653b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41051,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/f0166b53-82f4-4b4b-aef1-7df1a130b02d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315a462f-b1fb-5767-99b3-d3e45f95653b/315a462f-b1fb-5767-99b3-d3e45f95653b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47621,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/4bcfea0b-3877-4b2b-911d-d7813da4fcd9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315a462f-b1fb-5767-99b3-d3e45f95653b/315a462f-b1fb-5767-99b3-d3e45f95653b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36892,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/61489502-b40d-4f40-95bf-8b4d75a802d2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315a462f-b1fb-5767-99b3-d3e45f95653b/315a462f-b1fb-5767-99b3-d3e45f95653b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27717,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/ca6a3055-4e9c-42b6-93e6-7a8bb1e6056e_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-29',
 'seller_name': 'Manamanx Ltd',
 'title': 'MG MOTOR UK MG3 HATCHBACK 1.5 VTi-TECH Exclusive 5dr',
 'transmission': 'manual',
 'trim': '1.5 VTi-TECH Exclusive 5dr',
 'vin': None,
 'year': 2019}
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117632563%27 HTTP/1.1" 200 None
2025-12-01 19:03:22 [astonbarclay.gb] INFO: Saving data for 117632563: {'created_time': 1764615802.843844, 'last_price_update_time': 1764615802.843852, 'auction_closing_time': 1764610200.0}
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117632563') HTTP/1.1" 204 0
2025-12-01 19:03:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117418998, 'registration': 'FR19KDO', 'account': 'THE109', 'make': 'MG MOTOR UK', 'model': 'MG3 HATCHBACK', 'derivative': '1.5 VTi-TECH Excite 5dr', 'mileage': 43242, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 216}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-07-24', 'fuel': 'Petrol', 'motExpiry': '2026-07-24', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'YELLOW', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print OIL & FILTER CHANGE 06/25', 'remarks': 'SPARE KEY VOSA STATES 18K 26K 34K 40K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/921eb6bc-271a-431a-a19f-8abc56630039.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117418998, 'registration': 'FR19KDO', 'account': 'THE109', 'make': 'MG MOTOR UK', 'model': 'MG3 HATCHBACK', 'derivative': '1.5 VTi-TECH Excite 5dr', 'mileage': 43242, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 216}, 'saleStart': '2025-12-04T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-07-24', 'fuel': 'Petrol', 'motExpiry': '2026-07-24', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'YELLOW', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print OIL & FILTER CHANGE 06/25', 'remarks': 'SPARE KEY VOSA STATES 18K 26K 34K 40K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/921eb6bc-271a-431a-a19f-8abc56630039.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aaf5ba6f-1057-5020-80b9-30ac569a4f76 with identifier: 117418998
2025-12-01 19:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aaf5ba6f-1057-5020-80b9-30ac569a4f76 with scrape type 1
2025-12-01 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item aaf5ba6f-1057-5020-80b9-30ac569a4f76
2025-12-01 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item aaf5ba6f-1057-5020-80b9-30ac569a4f76
2025-12-01 19:03:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: aaf5ba6f-1057-5020-80b9-30ac569a4f76, identifier: 117418998
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLT74PGO%252F2025-11-21%252Fimage%252F443f35c6-b669-43bb-b5f5-b6a21fc9df5f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT74PGO/2025-11-21/image/443f35c6-b669-43bb-b5f5-b6a21fc9df5f_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117545534?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:03:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: aaf5ba6f-1057-5020-80b9-30ac569a4f76 with identifier: 117418998
2025-12-01 19:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: aaf5ba6f-1057-5020-80b9-30ac569a4f76 with identifier: 117418998
2025-12-01 19:03:23 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: aaf5ba6f-1057-5020-80b9-30ac569a4f76 with identifier: 117418998 to the API
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27aaf5ba6f-1057-5020-80b9-30ac569a4f76%27 HTTP/1.1" 200 None
2025-12-01 19:03:23 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id aaf5ba6f-1057-5020-80b9-30ac569a4f76: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:03:22 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:03:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117418998?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'YELLOW',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'aaf5ba6f-1057-5020-80b9-30ac569a4f76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FR19KDO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117418998',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'MG MOTOR UK',
 'model': 'MG3 HATCHBACK',
 'odometer': 43242,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-24',
 'seller_name': 'TCB Group - Prime',
 'title': 'MG MOTOR UK MG3 HATCHBACK 1.5 VTi-TECH Excite 5dr',
 'transmission': 'manual',
 'trim': '1.5 VTi-TECH Excite 5dr',
 'vin': None,
 'year': 2019}
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117418998%27 HTTP/1.1" 200 None
2025-12-01 19:03:23 [astonbarclay.gb] INFO: Saving data for 117418998: {'created_time': 1764615803.250091, 'last_price_update_time': 1764615803.250102, 'auction_closing_time': 1764842400.0}
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117418998') HTTP/1.1" 204 0
2025-12-01 19:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e71e010>
2025-12-01 19:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b4c2d7-187b-5876-a316-a5afbbcf6cdf/f2b4c2d7-187b-5876-a316-a5afbbcf6cdf_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLN73OFU%252F2025-11-27%252Fimage%252F921414e8-64e3-448b-a152-f2e85f71fb43_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN73OFU/2025-11-27/image/921414e8-64e3-448b-a152-f2e85f71fb43_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f2b4c2d7-187b-5876-a316-a5afbbcf6cdf
2025-12-01 19:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e8afd10>
2025-12-01 19:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee9ea4a-1d35-54dd-ac37-06a67c77e6ec/aee9ea4a-1d35-54dd-ac37-06a67c77e6ec_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAP74FTD%252F2025-11-21%252Fimage%252Fda028012-3e27-4e83-bc3d-471d864f6ab2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP74FTD/2025-11-21/image/da028012-3e27-4e83-bc3d-471d864f6ab2_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aee9ea4a-1d35-54dd-ac37-06a67c77e6ec
2025-12-01 19:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LN74OYX/2025-11-21/image/0fde4743-98cb-4b3a-8d50-3304d420ab80_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117415829?view=catalogue)
2025-12-01 19:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LN73OFU/2025-11-27/image/be2d3a6c-129c-4222-a0a2-8ea76016b1a9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117492820?view=catalogue)
2025-12-01 19:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AP74FTD/2025-11-21/image/be9f1ba6-ef7e-4818-abb3-cd4c4f0958d1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117394487?view=catalogue)
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAP74FTD%252F2025-11-21%252Fimage%252F20030a71-fa87-49db-99ec-df66757c4dea_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP74FTD/2025-11-21/image/20030a71-fa87-49db-99ec-df66757c4dea_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLN73OFU%252F2025-11-27%252Fimage%252F1f8e0753-883a-4bc4-bb1d-cce4fddfed12_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN73OFU/2025-11-27/image/1f8e0753-883a-4bc4-bb1d-cce4fddfed12_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLN74OYX%252F2025-11-21%252Fimage%252Fe93add83-58a4-49db-a2ca-00d5196bc0cf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN74OYX/2025-11-21/image/e93add83-58a4-49db-a2ca-00d5196bc0cf_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F50763228-ed37-4fc6-bb14-9272756ad2c5.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/50763228-ed37-4fc6-bb14-9272756ad2c5.jpg?w=600 not downloaded yet
2025-12-01 19:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117640138?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e7e4a10>
2025-12-01 19:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6ff7ec9-3cc9-5036-b785-6abff98081d3/a6ff7ec9-3cc9-5036-b785-6abff98081d3_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLT74PGO%252F2025-11-21%252Fimage%252F3873d6cd-5063-4a36-9827-7b9cd03323a1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT74PGO/2025-11-21/image/3873d6cd-5063-4a36-9827-7b9cd03323a1_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a6ff7ec9-3cc9-5036-b785-6abff98081d3
2025-12-01 19:03:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117348031, 'registration': 'EF19DYX', 'account': 'TR', 'make': 'FORD', 'model': 'FOCUS DIESEL ESTATE', 'derivative': '1.5 EcoBlue 120 Titanium X 5dr Auto', 'mileage': 44469, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-04-02', 'fuel': 'Diesel', 'motExpiry': '2026-07-05', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EF19DYX/2025-11-19/image/d14249bc-d87e-4ea5-9954-04cd878da64d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/fd355f97-3cc3-455b-b495-977dbd092b32_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/dba3bf98-ffe3-4cbb-b80c-4e555f558f97_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/2c8bdc32-617a-4fc2-a94f-d38a8ac7ea60_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/0bef7d4f-b4d5-4d2a-99ba-e3db096db2d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/4fea055c-63da-46c8-a0a0-2ca9ef39da14_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/2704b5c9-532c-4de3-b7d1-6aa867cf7c3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/5738d4e9-e699-4ef2-81f3-671d9fce6e34_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/fb2acde6-91a5-4300-b5ee-4a54d00505d7_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print EMPTY SERVICE BOOK - 09/25 41K', 'remarks': 'VOSA STATES, 3K, 3K, 19K, 37K', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 116, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/debe61eb-8d98-468c-bd40-02126d8550a6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117348031, 'registration': 'EF19DYX', 'account': 'TR', 'make': 'FORD', 'model': 'FOCUS DIESEL ESTATE', 'derivative': '1.5 EcoBlue 120 Titanium X 5dr Auto', 'mileage': 44469, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-04-02', 'fuel': 'Diesel', 'motExpiry': '2026-07-05', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EF19DYX/2025-11-19/image/d14249bc-d87e-4ea5-9954-04cd878da64d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/fd355f97-3cc3-455b-b495-977dbd092b32_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/dba3bf98-ffe3-4cbb-b80c-4e555f558f97_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/2c8bdc32-617a-4fc2-a94f-d38a8ac7ea60_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/0bef7d4f-b4d5-4d2a-99ba-e3db096db2d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/4fea055c-63da-46c8-a0a0-2ca9ef39da14_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/2704b5c9-532c-4de3-b7d1-6aa867cf7c3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/5738d4e9-e699-4ef2-81f3-671d9fce6e34_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/fb2acde6-91a5-4300-b5ee-4a54d00505d7_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print EMPTY SERVICE BOOK - 09/25 41K', 'remarks': 'VOSA STATES, 3K, 3K, 19K, 37K', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 116, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/debe61eb-8d98-468c-bd40-02126d8550a6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7f29717-6381-54ba-bb0c-49c01859b90f with identifier: 117348031
2025-12-01 19:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7f29717-6381-54ba-bb0c-49c01859b90f with scrape type 1
2025-12-01 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item b7f29717-6381-54ba-bb0c-49c01859b90f
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF19DYX%252F2025-11-19%252Fimage%252Fd14249bc-d87e-4ea5-9954-04cd878da64d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF19DYX/2025-11-19/image/d14249bc-d87e-4ea5-9954-04cd878da64d_removebg.jpg?w=600 already downloaded
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF19DYX%252F2025-11-19%252Fimage%252Ffd355f97-3cc3-455b-b495-977dbd092b32_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF19DYX/2025-11-19/image/fd355f97-3cc3-455b-b495-977dbd092b32_removebg.jpg?w=600 already downloaded
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF19DYX%252F2025-11-19%252Fimage%252Fdba3bf98-ffe3-4cbb-b80c-4e555f558f97_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF19DYX/2025-11-19/image/dba3bf98-ffe3-4cbb-b80c-4e555f558f97_removebg.jpg?w=600 already downloaded
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF19DYX%252F2025-11-19%252Fimage%252F2c8bdc32-617a-4fc2-a94f-d38a8ac7ea60_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF19DYX/2025-11-19/image/2c8bdc32-617a-4fc2-a94f-d38a8ac7ea60_removebg.jpg?w=600 already downloaded
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF19DYX%252F2025-11-19%252Fimage%252F0bef7d4f-b4d5-4d2a-99ba-e3db096db2d8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF19DYX/2025-11-19/image/0bef7d4f-b4d5-4d2a-99ba-e3db096db2d8_removebg.jpg?w=600 already downloaded
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF19DYX%252F2025-11-19%252Fimage%252F4fea055c-63da-46c8-a0a0-2ca9ef39da14_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF19DYX/2025-11-19/image/4fea055c-63da-46c8-a0a0-2ca9ef39da14_removebg.jpg?w=600 already downloaded
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF19DYX%252F2025-11-19%252Fimage%252F2704b5c9-532c-4de3-b7d1-6aa867cf7c3d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF19DYX/2025-11-19/image/2704b5c9-532c-4de3-b7d1-6aa867cf7c3d_removebg.jpg?w=600 already downloaded
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF19DYX%252F2025-11-19%252Fimage%252F5738d4e9-e699-4ef2-81f3-671d9fce6e34_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF19DYX/2025-11-19/image/5738d4e9-e699-4ef2-81f3-671d9fce6e34_removebg.jpg?w=600 already downloaded
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEF19DYX%252F2025-11-19%252Fimage%252Ffb2acde6-91a5-4300-b5ee-4a54d00505d7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EF19DYX/2025-11-19/image/fb2acde6-91a5-4300-b5ee-4a54d00505d7_removebg.jpg?w=600 already downloaded
2025-12-01 19:03:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b7f29717-6381-54ba-bb0c-49c01859b90f, identifier: 117348031
2025-12-01 19:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LT74PGO/2025-11-21/image/f63042ba-0c73-4d2b-a2ed-e278b8e2b06f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117395964?view=catalogue)
2025-12-01 19:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117579419?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:03:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b7f29717-6381-54ba-bb0c-49c01859b90f with identifier: 117348031
2025-12-01 19:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b7f29717-6381-54ba-bb0c-49c01859b90f with identifier: 117348031
2025-12-01 19:03:24 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b7f29717-6381-54ba-bb0c-49c01859b90f with identifier: 117348031 to the API
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:03:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117348031?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'b7f29717-6381-54ba-bb0c-49c01859b90f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EF19DYX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117348031',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'FOCUS DIESEL ESTATE',
 'odometer': 44469,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photo_urls': ['https://abimg003.imgix.net/EF19DYX/2025-11-19/image/d14249bc-d87e-4ea5-9954-04cd878da64d_removebg.jpg?w=600',
                'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/fd355f97-3cc3-455b-b495-977dbd092b32_removebg.jpg?w=600',
                'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/dba3bf98-ffe3-4cbb-b80c-4e555f558f97_removebg.jpg?w=600',
                'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/2c8bdc32-617a-4fc2-a94f-d38a8ac7ea60_removebg.jpg?w=600',
                'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/0bef7d4f-b4d5-4d2a-99ba-e3db096db2d8_removebg.jpg?w=600',
                'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/4fea055c-63da-46c8-a0a0-2ca9ef39da14_removebg.jpg?w=600',
                'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/2704b5c9-532c-4de3-b7d1-6aa867cf7c3d_removebg.jpg?w=600',
                'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/5738d4e9-e699-4ef2-81f3-671d9fce6e34_removebg.jpg?w=600',
                'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/fb2acde6-91a5-4300-b5ee-4a54d00505d7_removebg.jpg?w=600'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f29717-6381-54ba-bb0c-49c01859b90f/b7f29717-6381-54ba-bb0c-49c01859b90f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38115,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/d14249bc-d87e-4ea5-9954-04cd878da64d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f29717-6381-54ba-bb0c-49c01859b90f/b7f29717-6381-54ba-bb0c-49c01859b90f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37378,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/fd355f97-3cc3-455b-b495-977dbd092b32_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f29717-6381-54ba-bb0c-49c01859b90f/b7f29717-6381-54ba-bb0c-49c01859b90f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38412,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/dba3bf98-ffe3-4cbb-b80c-4e555f558f97_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f29717-6381-54ba-bb0c-49c01859b90f/b7f29717-6381-54ba-bb0c-49c01859b90f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37499,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/2c8bdc32-617a-4fc2-a94f-d38a8ac7ea60_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f29717-6381-54ba-bb0c-49c01859b90f/b7f29717-6381-54ba-bb0c-49c01859b90f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48904,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/0bef7d4f-b4d5-4d2a-99ba-e3db096db2d8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f29717-6381-54ba-bb0c-49c01859b90f/b7f29717-6381-54ba-bb0c-49c01859b90f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48233,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/4fea055c-63da-46c8-a0a0-2ca9ef39da14_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f29717-6381-54ba-bb0c-49c01859b90f/b7f29717-6381-54ba-bb0c-49c01859b90f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48589,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/2704b5c9-532c-4de3-b7d1-6aa867cf7c3d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f29717-6381-54ba-bb0c-49c01859b90f/b7f29717-6381-54ba-bb0c-49c01859b90f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49590,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/5738d4e9-e699-4ef2-81f3-671d9fce6e34_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f29717-6381-54ba-bb0c-49c01859b90f/b7f29717-6381-54ba-bb0c-49c01859b90f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59384,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EF19DYX/2025-11-19/image/fb2acde6-91a5-4300-b5ee-4a54d00505d7_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-02',
 'seller_name': None,
 'title': 'FORD FOCUS DIESEL ESTATE 1.5 EcoBlue 120 Titanium X 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.5 EcoBlue 120 Titanium X 5dr Auto',
 'vin': None,
 'year': 2019}
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117348031%27 HTTP/1.1" 200 None
2025-12-01 19:03:24 [astonbarclay.gb] INFO: Saving data for 117348031: {'created_time': 1764615804.613759, 'last_price_update_time': 1764615804.613771, 'auction_closing_time': 1764756000.0}
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117348031') HTTP/1.1" 204 0
2025-12-01 19:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6c7c50>
2025-12-01 19:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b4c2d7-187b-5876-a316-a5afbbcf6cdf/f2b4c2d7-187b-5876-a316-a5afbbcf6cdf_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLN73OFU%252F2025-11-27%252Fimage%252Fb3bd0ada-53fe-47b8-a0ce-b3eaf660abbb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN73OFU/2025-11-27/image/b3bd0ada-53fe-47b8-a0ce-b3eaf660abbb_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f2b4c2d7-187b-5876-a316-a5afbbcf6cdf
2025-12-01 19:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f37a290>
2025-12-01 19:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLN74OYX%252F2025-11-21%252Fimage%252F7ba24871-2e5a-429b-9687-b74eae7434b6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN74OYX/2025-11-21/image/7ba24871-2e5a-429b-9687-b74eae7434b6_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 33d7290d-cc06-57b8-b4b5-7609a19c2a74
2025-12-01 19:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e854c10>
2025-12-01 19:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee9ea4a-1d35-54dd-ac37-06a67c77e6ec/aee9ea4a-1d35-54dd-ac37-06a67c77e6ec_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAP74FTD%252F2025-11-21%252Fimage%252Fb130b72f-71c1-4c32-9e77-298a592c3f67_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP74FTD/2025-11-21/image/b130b72f-71c1-4c32-9e77-298a592c3f67_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aee9ea4a-1d35-54dd-ac37-06a67c77e6ec
2025-12-01 19:03:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117563683, 'registration': 'LV72OEE', 'account': 'STE093', 'make': 'LAND ROVER', 'model': 'RANGE ROVER VELAR ESTATE', 'derivative': '2.0 P250 Edition 5dr Auto', 'mileage': 31577, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-22', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg002.imgix.net/4de15db8-5ac3-49c8-bcc0-c5ca43840708.jpg?w=600', 'https://abimg002.imgix.net/08ae5c96-da23-4edf-b372-fc9da949baee.jpg?w=600', 'https://abimg002.imgix.net/e0076464-fe61-4ec9-b4d6-9f2dff09cf23.jpg?w=600', 'https://abimg002.imgix.net/a06f617d-98c3-4967-8545-0e263709dadf.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 219, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/19c10ece-744b-4589-8d5b-77cb87be78e4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117563683, 'registration': 'LV72OEE', 'account': 'STE093', 'make': 'LAND ROVER', 'model': 'RANGE ROVER VELAR ESTATE', 'derivative': '2.0 P250 Edition 5dr Auto', 'mileage': 31577, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-22', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg002.imgix.net/4de15db8-5ac3-49c8-bcc0-c5ca43840708.jpg?w=600', 'https://abimg002.imgix.net/08ae5c96-da23-4edf-b372-fc9da949baee.jpg?w=600', 'https://abimg002.imgix.net/e0076464-fe61-4ec9-b4d6-9f2dff09cf23.jpg?w=600', 'https://abimg002.imgix.net/a06f617d-98c3-4967-8545-0e263709dadf.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 219, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/19c10ece-744b-4589-8d5b-77cb87be78e4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ce9d6c2-358c-537f-ae31-5824863864ff with identifier: 117563683
2025-12-01 19:03:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ce9d6c2-358c-537f-ae31-5824863864ff with scrape type 1
2025-12-01 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 3ce9d6c2-358c-537f-ae31-5824863864ff
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F4de15db8-5ac3-49c8-bcc0-c5ca43840708.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/4de15db8-5ac3-49c8-bcc0-c5ca43840708.jpg?w=600 not downloaded yet
2025-12-01 19:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/ad78b1f2-6c91-4c1d-803a-6f5f1bcea517.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117585575?view=catalogue)
2025-12-01 19:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LN73OFU/2025-11-27/image/996933d0-7acf-45f9-b2db-93487c637ed8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117492820?view=catalogue)
2025-12-01 19:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LN74OYX/2025-11-21/image/17c67160-5a92-4b68-803c-a35b8458a4e5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117415829?view=catalogue)
2025-12-01 19:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AP74FTD/2025-11-21/image/a5ff6f6f-ec51-4f61-9b17-11d20da18da4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117394487?view=catalogue)
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAP74FTD%252F2025-11-21%252Fimage%252Fd76f266c-28b8-409f-a1a2-c5d55d942696_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP74FTD/2025-11-21/image/d76f266c-28b8-409f-a1a2-c5d55d942696_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLN73OFU%252F2025-11-27%252Fimage%252F45f27f64-03f4-40e9-ad51-11ed32688d29_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN73OFU/2025-11-27/image/45f27f64-03f4-40e9-ad51-11ed32688d29_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLN74OYX%252F2025-11-21%252Fimage%252Fc0e0bc52-b7c5-431d-bc79-90b76400df49_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN74OYX/2025-11-21/image/c0e0bc52-b7c5-431d-bc79-90b76400df49_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fd55e6883-e641-4115-b07c-237bd61708f5.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/d55e6883-e641-4115-b07c-237bd61708f5.jpg?w=600 not downloaded yet
2025-12-01 19:03:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:03:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117545534, 'registration': 'AK18MKN', 'account': 'ALL018', 'make': 'SKODA', 'model': 'OCTAVIA ESTATE', 'derivative': '1.0 TSI SE Technology 5dr', 'mileage': 82059, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-05-10', 'fuel': 'Petrol', 'motExpiry': '2026-11-06', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service invoice 02/20-23K 02/22-44K 06/23-63K 08/24-71K', 'remarks': 'VOSA STATES 59K 65K 73K 81K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/952a27e7-b498-4d08-b26c-9b74d666a28c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117545534, 'registration': 'AK18MKN', 'account': 'ALL018', 'make': 'SKODA', 'model': 'OCTAVIA ESTATE', 'derivative': '1.0 TSI SE Technology 5dr', 'mileage': 82059, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-05-10', 'fuel': 'Petrol', 'motExpiry': '2026-11-06', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service invoice 02/20-23K 02/22-44K 06/23-63K 08/24-71K', 'remarks': 'VOSA STATES 59K 65K 73K 81K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/952a27e7-b498-4d08-b26c-9b74d666a28c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e6dacb7-11d7-5ff4-bd8c-ce1a62cb7d24 with identifier: 117545534
2025-12-01 19:03:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e6dacb7-11d7-5ff4-bd8c-ce1a62cb7d24 with scrape type 1
2025-12-01 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 2e6dacb7-11d7-5ff4-bd8c-ce1a62cb7d24
2025-12-01 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 2e6dacb7-11d7-5ff4-bd8c-ce1a62cb7d24
2025-12-01 19:03:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2e6dacb7-11d7-5ff4-bd8c-ce1a62cb7d24, identifier: 117545534
2025-12-01 19:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LT74PGO/2025-11-21/image/91017f22-9fea-4e74-b8e8-8a1b002cbc9a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117395964?view=catalogue)
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F08ae5c96-da23-4edf-b372-fc9da949baee.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/08ae5c96-da23-4edf-b372-fc9da949baee.jpg?w=600 not downloaded yet
2025-12-01 19:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117031158?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2e6dacb7-11d7-5ff4-bd8c-ce1a62cb7d24 with identifier: 117545534
2025-12-01 19:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2e6dacb7-11d7-5ff4-bd8c-ce1a62cb7d24 with identifier: 117545534
2025-12-01 19:03:25 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2e6dacb7-11d7-5ff4-bd8c-ce1a62cb7d24 with identifier: 117545534 to the API
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%272e6dacb7-11d7-5ff4-bd8c-ce1a62cb7d24%27 HTTP/1.1" 200 None
2025-12-01 19:03:25 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 2e6dacb7-11d7-5ff4-bd8c-ce1a62cb7d24: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:03:24 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:03:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117545534?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '2e6dacb7-11d7-5ff4-bd8c-ce1a62cb7d24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AK18MKN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117545534',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'SKODA',
 'model': 'OCTAVIA ESTATE',
 'odometer': 82059,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-10',
 'seller_name': 'SMC GROUP',
 'title': 'SKODA OCTAVIA ESTATE 1.0 TSI SE Technology 5dr',
 'transmission': 'manual',
 'trim': '1.0 TSI SE Technology 5dr',
 'vin': None,
 'year': 2018}
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117545534%27 HTTP/1.1" 200 None
2025-12-01 19:03:25 [astonbarclay.gb] INFO: Saving data for 117545534: {'created_time': 1764615805.867672, 'last_price_update_time': 1764615805.867682, 'auction_closing_time': 1764756000.0}
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117545534') HTTP/1.1" 204 0
2025-12-01 19:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6093d0>
2025-12-01 19:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLN74OYX%252F2025-11-21%252Fimage%252F0fde4743-98cb-4b3a-8d50-3304d420ab80_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN74OYX/2025-11-21/image/0fde4743-98cb-4b3a-8d50-3304d420ab80_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 33d7290d-cc06-57b8-b4b5-7609a19c2a74
2025-12-01 19:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f28cf10>
2025-12-01 19:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b4c2d7-187b-5876-a316-a5afbbcf6cdf/f2b4c2d7-187b-5876-a316-a5afbbcf6cdf_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLN73OFU%252F2025-11-27%252Fimage%252Fbe2d3a6c-129c-4222-a0a2-8ea76016b1a9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN73OFU/2025-11-27/image/be2d3a6c-129c-4222-a0a2-8ea76016b1a9_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f2b4c2d7-187b-5876-a316-a5afbbcf6cdf
2025-12-01 19:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e802810>
2025-12-01 19:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee9ea4a-1d35-54dd-ac37-06a67c77e6ec/aee9ea4a-1d35-54dd-ac37-06a67c77e6ec_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAP74FTD%252F2025-11-21%252Fimage%252Fbe9f1ba6-ef7e-4818-abb3-cd4c4f0958d1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP74FTD/2025-11-21/image/be9f1ba6-ef7e-4818-abb3-cd4c4f0958d1_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aee9ea4a-1d35-54dd-ac37-06a67c77e6ec
2025-12-01 19:03:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117640138, 'registration': 'LB65AVM', 'account': 'STE009', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost Zetec 5dr', 'mileage': 48944, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2015-12-31', 'fuel': 'Petrol', 'motExpiry': '2026-01-25', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 99, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117640138, 'registration': 'LB65AVM', 'account': 'STE009', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost Zetec 5dr', 'mileage': 48944, 'mileageWarranty': True, 'type': 'car', 'saleId': 17972, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2015-12-31', 'fuel': 'Petrol', 'motExpiry': '2026-01-25', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 99, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 033f68f8-1feb-5349-b2e6-b5333194ee88 with identifier: 117640138
2025-12-01 19:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 033f68f8-1feb-5349-b2e6-b5333194ee88 with scrape type 1
2025-12-01 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 033f68f8-1feb-5349-b2e6-b5333194ee88
2025-12-01 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 033f68f8-1feb-5349-b2e6-b5333194ee88
2025-12-01 19:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 033f68f8-1feb-5349-b2e6-b5333194ee88, identifier: 117640138
2025-12-01 19:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LN74OYX/2025-11-21/image/327c4776-009a-4e39-9e86-72d89206f227_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117415829?view=catalogue)
2025-12-01 19:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LN73OFU/2025-11-27/image/20c329c2-4789-4011-9437-56b7d16d0930_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117492820?view=catalogue)
2025-12-01 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLN73OFU%252F2025-11-27%252Fimage%252F54e18268-bd12-40ae-a9cb-b13f9d777c3a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN73OFU/2025-11-27/image/54e18268-bd12-40ae-a9cb-b13f9d777c3a_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLN74OYX%252F2025-11-21%252Fimage%252F9f80509d-ef47-42e4-aa07-c83131fa59d9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN74OYX/2025-11-21/image/9f80509d-ef47-42e4-aa07-c83131fa59d9_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117024058?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:03:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 033f68f8-1feb-5349-b2e6-b5333194ee88 with identifier: 117640138
2025-12-01 19:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 033f68f8-1feb-5349-b2e6-b5333194ee88 with identifier: 117640138
2025-12-01 19:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-01 19:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 033f68f8-1feb-5349-b2e6-b5333194ee88 spider: astonbarclay.gb
2025-12-01 19:03:26 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 033f68f8-1feb-5349-b2e6-b5333194ee88 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '033f68f8-1feb-5349-b2e6-b5333194ee88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LB65AVM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117640138',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'FIESTA HATCHBACK',
 'odometer': 48944,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-31',
 'seller_name': 'Hedin Automotive BMW',
 'title': 'FORD FIESTA HATCHBACK 1.0 EcoBoost Zetec 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Zetec 5dr',
 'vin': None,
 'year': 2015}
2025-12-01 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117640138%27 HTTP/1.1" 200 None
2025-12-01 19:03:26 [astonbarclay.gb] INFO: Saving data for 117640138: {'created_time': 1764615806.999056, 'last_price_update_time': 1764615806.999066, 'auction_closing_time': 1764756000.0}
2025-12-01 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117640138') HTTP/1.1" 204 0
2025-12-01 19:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e630710>
2025-12-01 19:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-01 19:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6ff7ec9-3cc9-5036-b785-6abff98081d3/a6ff7ec9-3cc9-5036-b785-6abff98081d3_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLT74PGO%252F2025-11-21%252Fimage%252Ff63042ba-0c73-4d2b-a2ed-e278b8e2b06f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT74PGO/2025-11-21/image/f63042ba-0c73-4d2b-a2ed-e278b8e2b06f_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a6ff7ec9-3cc9-5036-b785-6abff98081d3
2025-12-01 19:03:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117579419, 'registration': 'LX16FGU', 'account': 'THE109', 'make': 'VAUXHALL', 'model': 'MOKKA HATCHBACK', 'derivative': '1.4T Exclusiv 5dr', 'mileage': 65647, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-01-26', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service book 06/18-9K 12/21-22K 12/22-41K 02/23-42K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 30K 41K 49K 57K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cc0b998a-b868-4c9e-b147-71b7d775a320.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117579419, 'registration': 'LX16FGU', 'account': 'THE109', 'make': 'VAUXHALL', 'model': 'MOKKA HATCHBACK', 'derivative': '1.4T Exclusiv 5dr', 'mileage': 65647, 'mileageWarranty': True, 'type': 'car', 'saleId': 17971, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 577}, 'saleStart': '2025-12-03T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-01-26', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service book 06/18-9K 12/21-22K 12/22-41K 02/23-42K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 30K 41K 49K 57K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cc0b998a-b868-4c9e-b147-71b7d775a320.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c9e4c11-1a70-509c-b875-18a9d9cb3171 with identifier: 117579419
2025-12-01 19:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c9e4c11-1a70-509c-b875-18a9d9cb3171 with scrape type 1
2025-12-01 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 8c9e4c11-1a70-509c-b875-18a9d9cb3171
2025-12-01 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 8c9e4c11-1a70-509c-b875-18a9d9cb3171
2025-12-01 19:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8c9e4c11-1a70-509c-b875-18a9d9cb3171, identifier: 117579419
2025-12-01 19:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LT74PGO/2025-11-21/image/443f35c6-b669-43bb-b5f5-b6a21fc9df5f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117395964?view=catalogue)
2025-12-01 19:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LT74PGO/2025-11-21/image/750b4384-eafe-48a6-9ee1-51482c8077a4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117395964?view=catalogue)
2025-12-01 19:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AP74FTD/2025-11-21/image/cbba9733-326e-48d6-aabc-83083fdfab0d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117394487?view=catalogue)
2025-12-01 19:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/4978e3b9-fe84-47ef-820b-e5907cb5c9d6.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117585575?view=catalogue)
2025-12-01 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fe0076464-fe61-4ec9-b4d6-9f2dff09cf23.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/e0076464-fe61-4ec9-b4d6-9f2dff09cf23.jpg?w=600 not downloaded yet
2025-12-01 19:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8c9e4c11-1a70-509c-b875-18a9d9cb3171 with identifier: 117579419
2025-12-01 19:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8c9e4c11-1a70-509c-b875-18a9d9cb3171 with identifier: 117579419
2025-12-01 19:03:27 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 8c9e4c11-1a70-509c-b875-18a9d9cb3171 with identifier: 117579419 to the API
2025-12-01 19:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%278c9e4c11-1a70-509c-b875-18a9d9cb3171%27 HTTP/1.1" 200 None
2025-12-01 19:03:27 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 8c9e4c11-1a70-509c-b875-18a9d9cb3171: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:03:26 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117579419?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '8c9e4c11-1a70-509c-b875-18a9d9cb3171',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LX16FGU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117579419',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'MOKKA HATCHBACK',
 'odometer': 65647,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-30',
 'seller_name': 'TCB Group - Prime',
 'title': 'VAUXHALL MOKKA HATCHBACK 1.4T Exclusiv 5dr',
 'transmission': 'manual',
 'trim': '1.4T Exclusiv 5dr',
 'vin': None,
 'year': 2016}
2025-12-01 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117579419%27 HTTP/1.1" 200 None
2025-12-01 19:03:27 [astonbarclay.gb] INFO: Saving data for 117579419: {'created_time': 1764615807.724282, 'last_price_update_time': 1764615807.724292, 'auction_closing_time': 1764756000.0}
2025-12-01 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117579419') HTTP/1.1" 204 0
2025-12-01 19:03:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:03:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:03:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e415190>
2025-12-01 19:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbb00730-a35e-55f9-b961-ea273271c11d/cbb00730-a35e-55f9-b961-ea273271c11d_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fad78b1f2-6c91-4c1d-803a-6f5f1bcea517.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/ad78b1f2-6c91-4c1d-803a-6f5f1bcea517.jpg?w=600 saved to cache
2025-12-01 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cbb00730-a35e-55f9-b961-ea273271c11d
2025-12-01 19:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6a03d0>
2025-12-01 19:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b4c2d7-187b-5876-a316-a5afbbcf6cdf/f2b4c2d7-187b-5876-a316-a5afbbcf6cdf_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLN73OFU%252F2025-11-27%252Fimage%252F996933d0-7acf-45f9-b2db-93487c637ed8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN73OFU/2025-11-27/image/996933d0-7acf-45f9-b2db-93487c637ed8_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f2b4c2d7-187b-5876-a316-a5afbbcf6cdf
2025-12-01 19:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f2896d0>
2025-12-01 19:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLN74OYX%252F2025-11-21%252Fimage%252F17c67160-5a92-4b68-803c-a35b8458a4e5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN74OYX/2025-11-21/image/17c67160-5a92-4b68-803c-a35b8458a4e5_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 33d7290d-cc06-57b8-b4b5-7609a19c2a74
2025-12-01 19:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e9c0ad0>
2025-12-01 19:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee9ea4a-1d35-54dd-ac37-06a67c77e6ec/aee9ea4a-1d35-54dd-ac37-06a67c77e6ec_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAP74FTD%252F2025-11-21%252Fimage%252Fa5ff6f6f-ec51-4f61-9b17-11d20da18da4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP74FTD/2025-11-21/image/a5ff6f6f-ec51-4f61-9b17-11d20da18da4_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aee9ea4a-1d35-54dd-ac37-06a67c77e6ec
2025-12-01 19:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LN73OFU/2025-11-27/image/1f8e0753-883a-4bc4-bb1d-cce4fddfed12_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117492820?view=catalogue)
2025-12-01 19:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LN74OYX/2025-11-21/image/e93add83-58a4-49db-a2ca-00d5196bc0cf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117415829?view=catalogue)
2025-12-01 19:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AP74FTD/2025-11-21/image/20030a71-fa87-49db-99ec-df66757c4dea_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117394487?view=catalogue)
2025-12-01 19:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/50763228-ed37-4fc6-bb14-9272756ad2c5.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117585575?view=catalogue)
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLN74OYX%252F2025-11-21%252Fimage%252Fcd47c374-aae7-4084-811f-d9d2a02f5b56_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN74OYX/2025-11-21/image/cd47c374-aae7-4084-811f-d9d2a02f5b56_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f50646f1f90>
2025-12-01 19:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6ff7ec9-3cc9-5036-b785-6abff98081d3/a6ff7ec9-3cc9-5036-b785-6abff98081d3_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLT74PGO%252F2025-11-21%252Fimage%252F91017f22-9fea-4e74-b8e8-8a1b002cbc9a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT74PGO/2025-11-21/image/91017f22-9fea-4e74-b8e8-8a1b002cbc9a_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a6ff7ec9-3cc9-5036-b785-6abff98081d3
2025-12-01 19:03:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117031158, 'registration': 'YS65OEF', 'account': 'KCS002', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.2 DiG-T Acenta Premium 5dr', 'mileage': 59545, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-02-27', 'fuel': 'Petrol', 'motExpiry': '2026-05-02', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YS65OEF/2025-11-10/image/81cc8444-232c-4597-83c8-dc957c7e03dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/870dd011-5f48-4ae5-9fae-2fdfffa6f5ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/87380db9-76cd-4b7d-8454-e672c14416e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/b5d056cf-bcab-4097-8487-2808f295ff5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/4c1959ee-6cc9-4f8c-a9aa-970edd8e87f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/2a8c7184-61cf-480e-b850-061ca15b3871_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/7a35beb0-040d-4daf-b65a-51381250c07b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/ebd71b64-7305-4d23-9096-1fbe5ee84cb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/6935df5a-541f-48ea-bd9c-1102cef9f263_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/c8b1c786-a003-405b-a0cb-7d51a7ed8356_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 02/17 10K 01/18 19K 05/19 30K 07/20 34K 07/21 36K 07/22 38K 07/23 40K 01/24 48K', 'remarks': 'S/KEY SD', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ecb7fe82-dff9-4750-a23b-a81c9f96593b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117031158, 'registration': 'YS65OEF', 'account': 'KCS002', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.2 DiG-T Acenta Premium 5dr', 'mileage': 59545, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-02-27', 'fuel': 'Petrol', 'motExpiry': '2026-05-02', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YS65OEF/2025-11-10/image/81cc8444-232c-4597-83c8-dc957c7e03dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/870dd011-5f48-4ae5-9fae-2fdfffa6f5ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/87380db9-76cd-4b7d-8454-e672c14416e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/b5d056cf-bcab-4097-8487-2808f295ff5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/4c1959ee-6cc9-4f8c-a9aa-970edd8e87f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/2a8c7184-61cf-480e-b850-061ca15b3871_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/7a35beb0-040d-4daf-b65a-51381250c07b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/ebd71b64-7305-4d23-9096-1fbe5ee84cb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/6935df5a-541f-48ea-bd9c-1102cef9f263_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS65OEF/2025-11-10/image/c8b1c786-a003-405b-a0cb-7d51a7ed8356_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 02/17 10K 01/18 19K 05/19 30K 07/20 34K 07/21 36K 07/22 38K 07/23 40K 01/24 48K', 'remarks': 'S/KEY SD', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ecb7fe82-dff9-4750-a23b-a81c9f96593b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90f804a5-8200-582a-bad4-53947e767941 with identifier: 117031158
2025-12-01 19:03:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90f804a5-8200-582a-bad4-53947e767941 with scrape type 2
2025-12-01 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90f804a5-8200-582a-bad4-53947e767941 with scrape type 2
2025-12-01 19:03:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 90f804a5-8200-582a-bad4-53947e767941, identifier: 117031158
2025-12-01 19:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/4de15db8-5ac3-49c8-bcc0-c5ca43840708.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117563683?view=catalogue)
2025-12-01 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fa06f617d-98c3-4967-8545-0e263709dadf.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/a06f617d-98c3-4967-8545-0e263709dadf.jpg?w=600 not downloaded yet
2025-12-01 19:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 90f804a5-8200-582a-bad4-53947e767941 with identifier: 117031158
2025-12-01 19:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 90f804a5-8200-582a-bad4-53947e767941 with identifier: 117031158
2025-12-01 19:03:29 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 90f804a5-8200-582a-bad4-53947e767941 with identifier: 117031158 to the API
2025-12-01 19:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2790f804a5-8200-582a-bad4-53947e767941%27 HTTP/1.1" 200 None
2025-12-01 19:03:29 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 90f804a5-8200-582a-bad4-53947e767941: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:03:28 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117031158?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '90f804a5-8200-582a-bad4-53947e767941',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YS65OEF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117031158',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'NISSAN',
 'model': 'JUKE HATCHBACK',
 'odometer': 59545,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-27',
 'seller_name': 'TCB Group - Prime',
 'title': 'NISSAN JUKE HATCHBACK 1.2 DiG-T Acenta Premium 5dr',
 'transmission': 'manual',
 'trim': '1.2 DiG-T Acenta Premium 5dr',
 'vin': None,
 'year': 2016}
2025-12-01 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117031158%27 HTTP/1.1" 200 None
2025-12-01 19:03:29 [astonbarclay.gb] INFO: Saving data for 117031158: {'auction_closing_time': 1764755100.0, 'created_time': 1762506126.703862, 'last_price_update_time': 1764615809.439476}
2025-12-01 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117031158') HTTP/1.1" 204 0
2025-12-01 19:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f2a9310>
2025-12-01 19:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLN74OYX%252F2025-11-21%252Fimage%252F327c4776-009a-4e39-9e86-72d89206f227_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN74OYX/2025-11-21/image/327c4776-009a-4e39-9e86-72d89206f227_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 33d7290d-cc06-57b8-b4b5-7609a19c2a74
2025-12-01 19:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e7c20d0>
2025-12-01 19:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b4c2d7-187b-5876-a316-a5afbbcf6cdf/f2b4c2d7-187b-5876-a316-a5afbbcf6cdf_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLN73OFU%252F2025-11-27%252Fimage%252F20c329c2-4789-4011-9437-56b7d16d0930_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN73OFU/2025-11-27/image/20c329c2-4789-4011-9437-56b7d16d0930_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f2b4c2d7-187b-5876-a316-a5afbbcf6cdf
2025-12-01 19:03:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117024058, 'registration': 'MR51ZUK', 'account': 'KCS002', 'make': 'VAUXHALL', 'model': 'GRANDLAND X HATCHBACK', 'derivative': '1.2 Turbo SE 5dr', 'mileage': 66518, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-02-11', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/0fbc2b6f-d2e4-4b71-9af0-a95b82da3901_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/b59f2b05-b1f0-4bac-8c0e-79908fd0e8a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/3d524d08-0902-4518-964e-0ffe909069f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/b62b162d-1959-4d54-a32e-1a4c25d7ad06_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/87467e67-a3d5-4dd0-a818-0dfed2579e1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/526ae119-922c-45a2-a923-ff39b2a1e23b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/96a5fc3c-84e0-45d5-b7f1-1130235f8667_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/069f69a2-c22d-499d-9dd5-e33f5b5cb56f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/501e76e6-43fe-4f39-8438-9d707d92d7a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/a5a01529-354b-4299-ba28-a47203256140_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'S/KEY - *Plate May Not Remain with Vehicle*', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e2cb7ebd-2729-41c9-8b34-ee3baed84e60.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117024058, 'registration': 'MR51ZUK', 'account': 'KCS002', 'make': 'VAUXHALL', 'model': 'GRANDLAND X HATCHBACK', 'derivative': '1.2 Turbo SE 5dr', 'mileage': 66518, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-02-11', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/0fbc2b6f-d2e4-4b71-9af0-a95b82da3901_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/b59f2b05-b1f0-4bac-8c0e-79908fd0e8a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/3d524d08-0902-4518-964e-0ffe909069f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/b62b162d-1959-4d54-a32e-1a4c25d7ad06_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/87467e67-a3d5-4dd0-a818-0dfed2579e1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/526ae119-922c-45a2-a923-ff39b2a1e23b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/96a5fc3c-84e0-45d5-b7f1-1130235f8667_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/069f69a2-c22d-499d-9dd5-e33f5b5cb56f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/501e76e6-43fe-4f39-8438-9d707d92d7a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/a5a01529-354b-4299-ba28-a47203256140_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'S/KEY - *Plate May Not Remain with Vehicle*', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e2cb7ebd-2729-41c9-8b34-ee3baed84e60.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9655b4b9-2675-58ef-a11e-03b69ddaeff4 with identifier: 117024058
2025-12-01 19:03:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9655b4b9-2675-58ef-a11e-03b69ddaeff4 with scrape type 2
2025-12-01 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9655b4b9-2675-58ef-a11e-03b69ddaeff4 with scrape type 2
2025-12-01 19:03:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9655b4b9-2675-58ef-a11e-03b69ddaeff4, identifier: 117024058
2025-12-01 19:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LN73OFU/2025-11-27/image/45f27f64-03f4-40e9-ad51-11ed32688d29_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117492820?view=catalogue)
2025-12-01 19:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LN74OYX/2025-11-21/image/c0e0bc52-b7c5-431d-bc79-90b76400df49_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117415829?view=catalogue)
2025-12-01 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLN74OYX%252F2025-11-21%252Fimage%252Fe52f3cee-3364-4d4f-86b3-c087cb6158b8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN74OYX/2025-11-21/image/e52f3cee-3364-4d4f-86b3-c087cb6158b8_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9655b4b9-2675-58ef-a11e-03b69ddaeff4 with identifier: 117024058
2025-12-01 19:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9655b4b9-2675-58ef-a11e-03b69ddaeff4 with identifier: 117024058
2025-12-01 19:03:30 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9655b4b9-2675-58ef-a11e-03b69ddaeff4 with identifier: 117024058 to the API
2025-12-01 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%279655b4b9-2675-58ef-a11e-03b69ddaeff4%27 HTTP/1.1" 200 None
2025-12-01 19:03:30 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 9655b4b9-2675-58ef-a11e-03b69ddaeff4: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:03:29 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:03:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117024058?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '9655b4b9-2675-58ef-a11e-03b69ddaeff4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MR51ZUK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117024058',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'VAUXHALL',
 'model': 'GRANDLAND X HATCHBACK',
 'odometer': 66518,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-30',
 'seller_name': 'TCB Group - Prime',
 'title': 'VAUXHALL GRANDLAND X HATCHBACK 1.2 Turbo SE 5dr',
 'transmission': 'manual',
 'trim': '1.2 Turbo SE 5dr',
 'vin': None,
 'year': 2018}
2025-12-01 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024058%27 HTTP/1.1" 200 None
2025-12-01 19:03:30 [astonbarclay.gb] INFO: Saving data for 117024058: {'auction_closing_time': 1764755100.0, 'created_time': 1762455702.144844, 'last_price_update_time': 1764615810.365679}
2025-12-01 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117024058') HTTP/1.1" 204 0
2025-12-01 19:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e66f050>
2025-12-01 19:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6ff7ec9-3cc9-5036-b785-6abff98081d3/a6ff7ec9-3cc9-5036-b785-6abff98081d3_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLT74PGO%252F2025-11-21%252Fimage%252F443f35c6-b669-43bb-b5f5-b6a21fc9df5f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT74PGO/2025-11-21/image/443f35c6-b669-43bb-b5f5-b6a21fc9df5f_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a6ff7ec9-3cc9-5036-b785-6abff98081d3
2025-12-01 19:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e99a8d0>
2025-12-01 19:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6ff7ec9-3cc9-5036-b785-6abff98081d3/a6ff7ec9-3cc9-5036-b785-6abff98081d3_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLT74PGO%252F2025-11-21%252Fimage%252F750b4384-eafe-48a6-9ee1-51482c8077a4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LT74PGO/2025-11-21/image/750b4384-eafe-48a6-9ee1-51482c8077a4_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a6ff7ec9-3cc9-5036-b785-6abff98081d3
2025-12-01 19:03:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6ff7ec9-3cc9-5036-b785-6abff98081d3, skipping ID generation
2025-12-01 19:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6ff7ec9-3cc9-5036-b785-6abff98081d3 with scrape type 1
2025-12-01 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a6ff7ec9-3cc9-5036-b785-6abff98081d3 from tracking dictionaries
2025-12-01 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a6ff7ec9-3cc9-5036-b785-6abff98081d3 sending to next pipeline
2025-12-01 19:03:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a6ff7ec9-3cc9-5036-b785-6abff98081d3, identifier: 117395964
2025-12-01 19:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f28c3d0>
2025-12-01 19:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee9ea4a-1d35-54dd-ac37-06a67c77e6ec/aee9ea4a-1d35-54dd-ac37-06a67c77e6ec_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAP74FTD%252F2025-11-21%252Fimage%252Fcbba9733-326e-48d6-aabc-83083fdfab0d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP74FTD/2025-11-21/image/cbba9733-326e-48d6-aabc-83083fdfab0d_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aee9ea4a-1d35-54dd-ac37-06a67c77e6ec
2025-12-01 19:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e76c290>
2025-12-01 19:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbb00730-a35e-55f9-b961-ea273271c11d/cbb00730-a35e-55f9-b961-ea273271c11d_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F4978e3b9-fe84-47ef-820b-e5907cb5c9d6.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/4978e3b9-fe84-47ef-820b-e5907cb5c9d6.jpg?w=600 saved to cache
2025-12-01 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cbb00730-a35e-55f9-b961-ea273271c11d
2025-12-01 19:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/08ae5c96-da23-4edf-b372-fc9da949baee.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117563683?view=catalogue)
2025-12-01 19:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/d55e6883-e641-4115-b07c-237bd61708f5.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117585575?view=catalogue)
2025-12-01 19:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AP74FTD/2025-11-21/image/d76f266c-28b8-409f-a1a2-c5d55d942696_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117394487?view=catalogue)
2025-12-01 19:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117633088?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:03:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a6ff7ec9-3cc9-5036-b785-6abff98081d3 with identifier: 117395964
2025-12-01 19:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a6ff7ec9-3cc9-5036-b785-6abff98081d3 with identifier: 117395964
2025-12-01 19:03:31 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a6ff7ec9-3cc9-5036-b785-6abff98081d3 with identifier: 117395964 to the API
2025-12-01 19:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:03:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LT74PGO/2025-11-21/image/750b4384-eafe-48a6-9ee1-51482c8077a4_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a6ff7ec9-3cc9-5036-b785-6abff98081d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LT74PGO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117395964',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'GLA HATCHBACK',
 'odometer': 24771,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6ff7ec9-3cc9-5036-b785-6abff98081d3/a6ff7ec9-3cc9-5036-b785-6abff98081d3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39876,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/fc78be48-d16a-4b51-ba5f-462c2fc036cc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6ff7ec9-3cc9-5036-b785-6abff98081d3/a6ff7ec9-3cc9-5036-b785-6abff98081d3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42161,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/ba76bcc3-8a4c-43f8-b0f0-616c1d383259_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6ff7ec9-3cc9-5036-b785-6abff98081d3/a6ff7ec9-3cc9-5036-b785-6abff98081d3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41676,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/5fd5ef5a-fab7-42ae-9738-5351c6cc472f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6ff7ec9-3cc9-5036-b785-6abff98081d3/a6ff7ec9-3cc9-5036-b785-6abff98081d3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42395,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/e4d68599-532a-4bbe-884f-f4a88f9ac699_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6ff7ec9-3cc9-5036-b785-6abff98081d3/a6ff7ec9-3cc9-5036-b785-6abff98081d3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39624,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/3873d6cd-5063-4a36-9827-7b9cd03323a1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6ff7ec9-3cc9-5036-b785-6abff98081d3/a6ff7ec9-3cc9-5036-b785-6abff98081d3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51409,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/750b4384-eafe-48a6-9ee1-51482c8077a4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6ff7ec9-3cc9-5036-b785-6abff98081d3/a6ff7ec9-3cc9-5036-b785-6abff98081d3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39863,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/f63042ba-0c73-4d2b-a2ed-e278b8e2b06f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6ff7ec9-3cc9-5036-b785-6abff98081d3/a6ff7ec9-3cc9-5036-b785-6abff98081d3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45207,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/91017f22-9fea-4e74-b8e8-8a1b002cbc9a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6ff7ec9-3cc9-5036-b785-6abff98081d3/a6ff7ec9-3cc9-5036-b785-6abff98081d3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33624,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LT74PGO/2025-11-21/image/443f35c6-b669-43bb-b5f5-b6a21fc9df5f_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-18',
 'seller_name': 'Motability Operations',
 'title': 'MERCEDES-BENZ GLA HATCHBACK GLA 200 AMG Line Premium 5dr Auto',
 'transmission': 'automatic',
 'trim': 'GLA 200 AMG Line Premium 5dr Auto',
 'vin': None,
 'year': 2024}
2025-12-01 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117395964%27 HTTP/1.1" 200 None
2025-12-01 19:03:31 [astonbarclay.gb] INFO: Saving data for 117395964: {'created_time': 1764615811.914763, 'last_price_update_time': 1764615811.914774, 'auction_closing_time': 1765792800.0}
2025-12-01 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117395964') HTTP/1.1" 204 0
2025-12-01 19:03:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e7f4dd0>
2025-12-01 19:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b4c2d7-187b-5876-a316-a5afbbcf6cdf/f2b4c2d7-187b-5876-a316-a5afbbcf6cdf_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLN73OFU%252F2025-11-27%252Fimage%252F1f8e0753-883a-4bc4-bb1d-cce4fddfed12_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN73OFU/2025-11-27/image/1f8e0753-883a-4bc4-bb1d-cce4fddfed12_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f2b4c2d7-187b-5876-a316-a5afbbcf6cdf
2025-12-01 19:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e76fad0>
2025-12-01 19:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLN74OYX%252F2025-11-21%252Fimage%252Fe93add83-58a4-49db-a2ca-00d5196bc0cf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN74OYX/2025-11-21/image/e93add83-58a4-49db-a2ca-00d5196bc0cf_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 33d7290d-cc06-57b8-b4b5-7609a19c2a74
2025-12-01 19:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e998790>
2025-12-01 19:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee9ea4a-1d35-54dd-ac37-06a67c77e6ec/aee9ea4a-1d35-54dd-ac37-06a67c77e6ec_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAP74FTD%252F2025-11-21%252Fimage%252F20030a71-fa87-49db-99ec-df66757c4dea_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP74FTD/2025-11-21/image/20030a71-fa87-49db-99ec-df66757c4dea_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aee9ea4a-1d35-54dd-ac37-06a67c77e6ec
2025-12-01 19:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e8f6490>
2025-12-01 19:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbb00730-a35e-55f9-b961-ea273271c11d/cbb00730-a35e-55f9-b961-ea273271c11d_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F50763228-ed37-4fc6-bb14-9272756ad2c5.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/50763228-ed37-4fc6-bb14-9272756ad2c5.jpg?w=600 saved to cache
2025-12-01 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cbb00730-a35e-55f9-b961-ea273271c11d
2025-12-01 19:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LN73OFU/2025-11-27/image/54e18268-bd12-40ae-a9cb-b13f9d777c3a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117492820?view=catalogue)
2025-12-01 19:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LN74OYX/2025-11-21/image/9f80509d-ef47-42e4-aa07-c83131fa59d9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117415829?view=catalogue)
2025-12-01 19:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SR18GBE/2025-12-01/image/ebf1de41-86ac-48e1-b595-f34af535f90c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117632517?view=catalogue)
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLN74OYX%252F2025-11-21%252Fimage%252Fca13aae3-8ad7-4469-bf3b-38b3608d4150_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN74OYX/2025-11-21/image/ca13aae3-8ad7-4469-bf3b-38b3608d4150_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117289360?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:03:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f241650>
2025-12-01 19:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ce9d6c2-358c-537f-ae31-5824863864ff/3ce9d6c2-358c-537f-ae31-5824863864ff_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F4de15db8-5ac3-49c8-bcc0-c5ca43840708.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/4de15db8-5ac3-49c8-bcc0-c5ca43840708.jpg?w=600 saved to cache
2025-12-01 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ce9d6c2-358c-537f-ae31-5824863864ff
2025-12-01 19:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/e0076464-fe61-4ec9-b4d6-9f2dff09cf23.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117563683?view=catalogue)
2025-12-01 19:03:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-01 19:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117131404?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e70a550>
2025-12-01 19:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b4c2d7-187b-5876-a316-a5afbbcf6cdf/f2b4c2d7-187b-5876-a316-a5afbbcf6cdf_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLN73OFU%252F2025-11-27%252Fimage%252F45f27f64-03f4-40e9-ad51-11ed32688d29_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN73OFU/2025-11-27/image/45f27f64-03f4-40e9-ad51-11ed32688d29_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f2b4c2d7-187b-5876-a316-a5afbbcf6cdf
2025-12-01 19:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f703250>
2025-12-01 19:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLN74OYX%252F2025-11-21%252Fimage%252Fc0e0bc52-b7c5-431d-bc79-90b76400df49_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN74OYX/2025-11-21/image/c0e0bc52-b7c5-431d-bc79-90b76400df49_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 33d7290d-cc06-57b8-b4b5-7609a19c2a74
2025-12-01 19:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SR18GBE/2025-12-01/image/667fa8c3-8d8a-4b85-b10d-df0c43337b4d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117632517?view=catalogue)
2025-12-01 19:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LN74OYX/2025-11-21/image/cd47c374-aae7-4084-811f-d9d2a02f5b56_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117415829?view=catalogue)
2025-12-01 19:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f7178d0>
2025-12-01 19:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ce9d6c2-358c-537f-ae31-5824863864ff/3ce9d6c2-358c-537f-ae31-5824863864ff_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F08ae5c96-da23-4edf-b372-fc9da949baee.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/08ae5c96-da23-4edf-b372-fc9da949baee.jpg?w=600 saved to cache
2025-12-01 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ce9d6c2-358c-537f-ae31-5824863864ff
2025-12-01 19:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505f37b010>
2025-12-01 19:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-01 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbb00730-a35e-55f9-b961-ea273271c11d/cbb00730-a35e-55f9-b961-ea273271c11d_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fd55e6883-e641-4115-b07c-237bd61708f5.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/d55e6883-e641-4115-b07c-237bd61708f5.jpg?w=600 saved to cache
2025-12-01 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cbb00730-a35e-55f9-b961-ea273271c11d
2025-12-01 19:03:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cbb00730-a35e-55f9-b961-ea273271c11d, skipping ID generation
2025-12-01 19:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbb00730-a35e-55f9-b961-ea273271c11d with scrape type 1
2025-12-01 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cbb00730-a35e-55f9-b961-ea273271c11d from tracking dictionaries
2025-12-01 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cbb00730-a35e-55f9-b961-ea273271c11d sending to next pipeline
2025-12-01 19:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: cbb00730-a35e-55f9-b961-ea273271c11d, identifier: 117585575
2025-12-01 19:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e5a2f50>
2025-12-01 19:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee9ea4a-1d35-54dd-ac37-06a67c77e6ec/aee9ea4a-1d35-54dd-ac37-06a67c77e6ec_image_9.jpg HTTP/1.1" 201 0
2025-12-01 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAP74FTD%252F2025-11-21%252Fimage%252Fd76f266c-28b8-409f-a1a2-c5d55d942696_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP74FTD/2025-11-21/image/d76f266c-28b8-409f-a1a2-c5d55d942696_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aee9ea4a-1d35-54dd-ac37-06a67c77e6ec
2025-12-01 19:03:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aee9ea4a-1d35-54dd-ac37-06a67c77e6ec, skipping ID generation
2025-12-01 19:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aee9ea4a-1d35-54dd-ac37-06a67c77e6ec with scrape type 1
2025-12-01 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item aee9ea4a-1d35-54dd-ac37-06a67c77e6ec from tracking dictionaries
2025-12-01 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aee9ea4a-1d35-54dd-ac37-06a67c77e6ec sending to next pipeline
2025-12-01 19:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: aee9ea4a-1d35-54dd-ac37-06a67c77e6ec, identifier: 117394487
2025-12-01 19:03:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117633088, 'registration': 'BP21VJZ', 'account': 'NIC026', 'make': 'NISSAN', 'model': 'MICRA HATCHBACK', 'derivative': '1.0 IG-T 92 Acenta 5dr CVT', 'mileage': 42018, 'mileageWarranty': False, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-09-08', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/5dd995d3-b1f3-4832-9f07-de0fc1c98448_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/54c4e76f-e1e0-47a7-a823-1d3afe54029b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/9f50c84c-6b86-4d9f-80f1-79288ee29428_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/80abf68f-e1bc-4789-9137-4f20d11ef084_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/b96c9726-60c0-4a1c-bc0c-0c5b30877255_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/b30108c0-5021-4ace-b3c0-ac4c49294250_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service invoice 09/25 (NO MILEAGE)', 'remarks': 'NO SPARE KEY', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3130d656-eb6d-4da4-bc62-5e3018a0b718.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117633088, 'registration': 'BP21VJZ', 'account': 'NIC026', 'make': 'NISSAN', 'model': 'MICRA HATCHBACK', 'derivative': '1.0 IG-T 92 Acenta 5dr CVT', 'mileage': 42018, 'mileageWarranty': False, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-09-08', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/5dd995d3-b1f3-4832-9f07-de0fc1c98448_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/54c4e76f-e1e0-47a7-a823-1d3afe54029b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/9f50c84c-6b86-4d9f-80f1-79288ee29428_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/80abf68f-e1bc-4789-9137-4f20d11ef084_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/b96c9726-60c0-4a1c-bc0c-0c5b30877255_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/b30108c0-5021-4ace-b3c0-ac4c49294250_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service invoice 09/25 (NO MILEAGE)', 'remarks': 'NO SPARE KEY', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3130d656-eb6d-4da4-bc62-5e3018a0b718.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 034ce54f-db67-523a-be2a-d5bd40f6f22c with identifier: 117633088
2025-12-01 19:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 034ce54f-db67-523a-be2a-d5bd40f6f22c with scrape type 1
2025-12-01 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 034ce54f-db67-523a-be2a-d5bd40f6f22c
2025-12-01 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBP21VJZ%252F2025-12-01%252Fimage%252F5dd995d3-b1f3-4832-9f07-de0fc1c98448_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/5dd995d3-b1f3-4832-9f07-de0fc1c98448_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SR18GBE/2025-12-01/image/2f415d98-1d27-4e50-b74f-d8a5a01545ce_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117632517?view=catalogue)
2025-12-01 19:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/a06f617d-98c3-4967-8545-0e263709dadf.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117563683?view=catalogue)
2025-12-01 19:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: cbb00730-a35e-55f9-b961-ea273271c11d with identifier: 117585575
2025-12-01 19:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: cbb00730-a35e-55f9-b961-ea273271c11d with identifier: 117585575
2025-12-01 19:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: cbb00730-a35e-55f9-b961-ea273271c11d with identifier: 117585575 to the API
2025-12-01 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/d55e6883-e641-4115-b07c-237bd61708f5.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'cbb00730-a35e-55f9-b961-ea273271c11d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AJ18ANJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117585575',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': 'X1 DIESEL ESTATE',
 'odometer': 41013,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb00730-a35e-55f9-b961-ea273271c11d/cbb00730-a35e-55f9-b961-ea273271c11d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56217,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/ad78b1f2-6c91-4c1d-803a-6f5f1bcea517.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb00730-a35e-55f9-b961-ea273271c11d/cbb00730-a35e-55f9-b961-ea273271c11d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55412,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/4978e3b9-fe84-47ef-820b-e5907cb5c9d6.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb00730-a35e-55f9-b961-ea273271c11d/cbb00730-a35e-55f9-b961-ea273271c11d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48852,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/50763228-ed37-4fc6-bb14-9272756ad2c5.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbb00730-a35e-55f9-b961-ea273271c11d/cbb00730-a35e-55f9-b961-ea273271c11d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46595,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/d55e6883-e641-4115-b07c-237bd61708f5.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-12',
 'seller_name': 'Hedin Automotive BMW',
 'title': 'BMW X1 DIESEL ESTATE xDrive 20d M Sport 5dr Step Auto',
 'transmission': 'automatic',
 'trim': 'xDrive 20d M Sport 5dr Step Auto',
 'vin': None,
 'year': 2018}
2025-12-01 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585575%27 HTTP/1.1" 200 None
2025-12-01 19:03:35 [astonbarclay.gb] INFO: Saving data for 117585575: {'created_time': 1764615815.818924, 'last_price_update_time': 1764615815.818939, 'auction_closing_time': 1764756000.0}
2025-12-01 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117585575') HTTP/1.1" 204 0
2025-12-01 19:03:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: aee9ea4a-1d35-54dd-ac37-06a67c77e6ec with identifier: 117394487
2025-12-01 19:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: aee9ea4a-1d35-54dd-ac37-06a67c77e6ec with identifier: 117394487
2025-12-01 19:03:35 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: aee9ea4a-1d35-54dd-ac37-06a67c77e6ec with identifier: 117394487 to the API
2025-12-01 19:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/AP74FTD/2025-11-21/image/d76f266c-28b8-409f-a1a2-c5d55d942696_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 27,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'aee9ea4a-1d35-54dd-ac37-06a67c77e6ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AP74FTD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117394487',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'KIA',
 'model': 'SPORTAGE ESTATE',
 'odometer': 16218,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aee9ea4a-1d35-54dd-ac37-06a67c77e6ec/aee9ea4a-1d35-54dd-ac37-06a67c77e6ec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38253,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/e100cf27-028c-41a5-8b00-2a23162381fe_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aee9ea4a-1d35-54dd-ac37-06a67c77e6ec/aee9ea4a-1d35-54dd-ac37-06a67c77e6ec_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42573,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/071fdd9e-b2f0-4ee5-92f3-5c36034febfd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aee9ea4a-1d35-54dd-ac37-06a67c77e6ec/aee9ea4a-1d35-54dd-ac37-06a67c77e6ec_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43080,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/01f5b861-641a-4d01-96fa-d725b39b2f1a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aee9ea4a-1d35-54dd-ac37-06a67c77e6ec/aee9ea4a-1d35-54dd-ac37-06a67c77e6ec_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41782,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/da028012-3e27-4e83-bc3d-471d864f6ab2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aee9ea4a-1d35-54dd-ac37-06a67c77e6ec/aee9ea4a-1d35-54dd-ac37-06a67c77e6ec_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48131,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/b130b72f-71c1-4c32-9e77-298a592c3f67_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aee9ea4a-1d35-54dd-ac37-06a67c77e6ec/aee9ea4a-1d35-54dd-ac37-06a67c77e6ec_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42229,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/be9f1ba6-ef7e-4818-abb3-cd4c4f0958d1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aee9ea4a-1d35-54dd-ac37-06a67c77e6ec/aee9ea4a-1d35-54dd-ac37-06a67c77e6ec_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48176,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/a5ff6f6f-ec51-4f61-9b17-11d20da18da4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aee9ea4a-1d35-54dd-ac37-06a67c77e6ec/aee9ea4a-1d35-54dd-ac37-06a67c77e6ec_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61374,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/cbba9733-326e-48d6-aabc-83083fdfab0d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aee9ea4a-1d35-54dd-ac37-06a67c77e6ec/aee9ea4a-1d35-54dd-ac37-06a67c77e6ec_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58157,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/20030a71-fa87-49db-99ec-df66757c4dea_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aee9ea4a-1d35-54dd-ac37-06a67c77e6ec/aee9ea4a-1d35-54dd-ac37-06a67c77e6ec_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51478,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AP74FTD/2025-11-21/image/d76f266c-28b8-409f-a1a2-c5d55d942696_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-01-28',
 'seller_name': 'Motability Operations',
 'title': 'KIA SPORTAGE ESTATE 1.6T GDi 241 PHEV GT-Line 5dr Auto AWD',
 'transmission': 'automatic',
 'trim': '1.6T GDi 241 PHEV GT-Line 5dr Auto AWD',
 'vin': None,
 'year': 2025}
2025-12-01 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117394487%27 HTTP/1.1" 200 None
2025-12-01 19:03:36 [astonbarclay.gb] INFO: Saving data for 117394487: {'created_time': 1764615816.216916, 'last_price_update_time': 1764615816.216927, 'auction_closing_time': 1765792800.0}
2025-12-01 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117394487') HTTP/1.1" 204 0
2025-12-01 19:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e6ba250>
2025-12-01 19:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b4c2d7-187b-5876-a316-a5afbbcf6cdf/f2b4c2d7-187b-5876-a316-a5afbbcf6cdf_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLN73OFU%252F2025-11-27%252Fimage%252F54e18268-bd12-40ae-a9cb-b13f9d777c3a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN73OFU/2025-11-27/image/54e18268-bd12-40ae-a9cb-b13f9d777c3a_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f2b4c2d7-187b-5876-a316-a5afbbcf6cdf
2025-12-01 19:03:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2b4c2d7-187b-5876-a316-a5afbbcf6cdf, skipping ID generation
2025-12-01 19:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2b4c2d7-187b-5876-a316-a5afbbcf6cdf with scrape type 1
2025-12-01 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f2b4c2d7-187b-5876-a316-a5afbbcf6cdf from tracking dictionaries
2025-12-01 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2b4c2d7-187b-5876-a316-a5afbbcf6cdf sending to next pipeline
2025-12-01 19:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f2b4c2d7-187b-5876-a316-a5afbbcf6cdf, identifier: 117492820
2025-12-01 19:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e8b5050>
2025-12-01 19:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLN74OYX%252F2025-11-21%252Fimage%252F9f80509d-ef47-42e4-aa07-c83131fa59d9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN74OYX/2025-11-21/image/9f80509d-ef47-42e4-aa07-c83131fa59d9_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 33d7290d-cc06-57b8-b4b5-7609a19c2a74
2025-12-01 19:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e8add10>
2025-12-01 19:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-01 19:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c34eeee2-e66c-53a2-a6bd-79ec8aa895ce/c34eeee2-e66c-53a2-a6bd-79ec8aa895ce_image_6.jpg HTTP/1.1" 201 0
2025-12-01 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSR18GBE%252F2025-12-01%252Fimage%252Febf1de41-86ac-48e1-b595-f34af535f90c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SR18GBE/2025-12-01/image/ebf1de41-86ac-48e1-b595-f34af535f90c_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c34eeee2-e66c-53a2-a6bd-79ec8aa895ce
2025-12-01 19:03:37 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117289360, 'registration': 'GF69HHM', 'account': 'KCS002', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 Active 5dr', 'mileage': 71629, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-10-17', 'fuel': 'Petrol', 'motExpiry': '2026-10-19', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GF69HHM/2025-11-19/image/1a2dd15f-507a-4089-8e3e-d33a62dde49a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/47bff8ab-5d6c-43bd-ba90-1949281f76a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/e910b2a3-b0a6-4a6b-a1c0-94f41a4b3240_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/a6a8f082-8492-4e04-ba9c-bd42e5b54df6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/a2cbdb09-b11f-4beb-8d74-52710d1642f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/8239aebf-a648-43af-89fe-9b669be696a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/8fa1ade3-8646-4e29-8792-dfc81efac79d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/f272f34c-eb38-48d1-bd76-98c6ba235e11_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/4ddebdb7-250c-4b2e-8b06-745505853fdf_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/b8ff893f-42a4-4400-91b4-4098fcaa4538_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/ce91928d-a13d-4889-8b14-e2b1aae7a8d6_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 07/21 18K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8b9b1822-37b2-4035-81a7-8edafbd4b9b8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:37 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117289360, 'registration': 'GF69HHM', 'account': 'KCS002', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 Active 5dr', 'mileage': 71629, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-10-17', 'fuel': 'Petrol', 'motExpiry': '2026-10-19', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GF69HHM/2025-11-19/image/1a2dd15f-507a-4089-8e3e-d33a62dde49a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/47bff8ab-5d6c-43bd-ba90-1949281f76a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/e910b2a3-b0a6-4a6b-a1c0-94f41a4b3240_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/a6a8f082-8492-4e04-ba9c-bd42e5b54df6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/a2cbdb09-b11f-4beb-8d74-52710d1642f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/8239aebf-a648-43af-89fe-9b669be696a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/8fa1ade3-8646-4e29-8792-dfc81efac79d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/f272f34c-eb38-48d1-bd76-98c6ba235e11_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/4ddebdb7-250c-4b2e-8b06-745505853fdf_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/b8ff893f-42a4-4400-91b4-4098fcaa4538_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/ce91928d-a13d-4889-8b14-e2b1aae7a8d6_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 07/21 18K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8b9b1822-37b2-4035-81a7-8edafbd4b9b8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d1d8a92-dc30-51b8-9ad1-5b7aba17c839 with identifier: 117289360
2025-12-01 19:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d1d8a92-dc30-51b8-9ad1-5b7aba17c839 with scrape type 2
2025-12-01 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d1d8a92-dc30-51b8-9ad1-5b7aba17c839 with scrape type 2
2025-12-01 19:03:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4d1d8a92-dc30-51b8-9ad1-5b7aba17c839, identifier: 117289360
2025-12-01 19:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SR18GBE/2025-12-01/image/4e9a8319-3cb7-4ec2-8244-18f777b181e5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117632517?view=catalogue)
2025-12-01 19:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LN74OYX/2025-11-21/image/e52f3cee-3364-4d4f-86b3-c087cb6158b8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117415829?view=catalogue)
2025-12-01 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBP21VJZ%252F2025-12-01%252Fimage%252F54c4e76f-e1e0-47a7-a823-1d3afe54029b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/54c4e76f-e1e0-47a7-a823-1d3afe54029b_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117024353?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:03:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f2b4c2d7-187b-5876-a316-a5afbbcf6cdf with identifier: 117492820
2025-12-01 19:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f2b4c2d7-187b-5876-a316-a5afbbcf6cdf with identifier: 117492820
2025-12-01 19:03:37 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f2b4c2d7-187b-5876-a316-a5afbbcf6cdf with identifier: 117492820 to the API
2025-12-01 19:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:03:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LN73OFU/2025-11-27/image/54e18268-bd12-40ae-a9cb-b13f9d777c3a_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'f2b4c2d7-187b-5876-a316-a5afbbcf6cdf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LN73OFU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117492820',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 20465,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b4c2d7-187b-5876-a316-a5afbbcf6cdf/f2b4c2d7-187b-5876-a316-a5afbbcf6cdf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35667,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/78f7c909-3bf2-4c31-aaf7-b56b4f56787a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b4c2d7-187b-5876-a316-a5afbbcf6cdf/f2b4c2d7-187b-5876-a316-a5afbbcf6cdf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32035,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/921414e8-64e3-448b-a152-f2e85f71fb43_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b4c2d7-187b-5876-a316-a5afbbcf6cdf/f2b4c2d7-187b-5876-a316-a5afbbcf6cdf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36367,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/b3bd0ada-53fe-47b8-a0ce-b3eaf660abbb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b4c2d7-187b-5876-a316-a5afbbcf6cdf/f2b4c2d7-187b-5876-a316-a5afbbcf6cdf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34014,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/be2d3a6c-129c-4222-a0a2-8ea76016b1a9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b4c2d7-187b-5876-a316-a5afbbcf6cdf/f2b4c2d7-187b-5876-a316-a5afbbcf6cdf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52447,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/996933d0-7acf-45f9-b2db-93487c637ed8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b4c2d7-187b-5876-a316-a5afbbcf6cdf/f2b4c2d7-187b-5876-a316-a5afbbcf6cdf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48305,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/20c329c2-4789-4011-9437-56b7d16d0930_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b4c2d7-187b-5876-a316-a5afbbcf6cdf/f2b4c2d7-187b-5876-a316-a5afbbcf6cdf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50296,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/1f8e0753-883a-4bc4-bb1d-cce4fddfed12_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b4c2d7-187b-5876-a316-a5afbbcf6cdf/f2b4c2d7-187b-5876-a316-a5afbbcf6cdf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46372,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/45f27f64-03f4-40e9-ad51-11ed32688d29_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b4c2d7-187b-5876-a316-a5afbbcf6cdf/f2b4c2d7-187b-5876-a316-a5afbbcf6cdf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53515,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LN73OFU/2025-11-27/image/54e18268-bd12-40ae-a9cb-b13f9d777c3a_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-14',
 'seller_name': 'Motability Operations',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH Acenta Premium 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T MH Acenta Premium 5dr',
 'vin': None,
 'year': 2023}
2025-12-01 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117492820%27 HTTP/1.1" 200 None
2025-12-01 19:03:38 [astonbarclay.gb] INFO: Saving data for 117492820: {'created_time': 1764615818.399328, 'last_price_update_time': 1764615818.399339, 'auction_closing_time': 1765792800.0}
2025-12-01 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117492820') HTTP/1.1" 204 0
2025-12-01 19:03:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4d1d8a92-dc30-51b8-9ad1-5b7aba17c839 with identifier: 117289360
2025-12-01 19:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4d1d8a92-dc30-51b8-9ad1-5b7aba17c839 with identifier: 117289360
2025-12-01 19:03:38 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4d1d8a92-dc30-51b8-9ad1-5b7aba17c839 with identifier: 117289360 to the API
2025-12-01 19:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%274d1d8a92-dc30-51b8-9ad1-5b7aba17c839%27 HTTP/1.1" 200 None
2025-12-01 19:03:38 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 4d1d8a92-dc30-51b8-9ad1-5b7aba17c839: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:03:37 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:03:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117289360?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '4d1d8a92-dc30-51b8-9ad1-5b7aba17c839',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GF69HHM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117289360',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'FORD',
 'model': 'FOCUS HATCHBACK',
 'odometer': 71629,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-17',
 'seller_name': 'TCB Group - Prime',
 'title': 'FORD FOCUS HATCHBACK 1.0 EcoBoost 125 Active 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125 Active 5dr',
 'vin': None,
 'year': 2019}
2025-12-01 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117289360%27 HTTP/1.1" 200 None
2025-12-01 19:03:38 [astonbarclay.gb] INFO: Saving data for 117289360: {'auction_closing_time': 1764755100.0, 'created_time': 1763456563.337558, 'last_price_update_time': 1764615818.685352}
2025-12-01 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117289360') HTTP/1.1" 204 0
2025-12-01 19:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e8acbd0>
2025-12-01 19:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ce9d6c2-358c-537f-ae31-5824863864ff/3ce9d6c2-358c-537f-ae31-5824863864ff_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fe0076464-fe61-4ec9-b4d6-9f2dff09cf23.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/e0076464-fe61-4ec9-b4d6-9f2dff09cf23.jpg?w=600 saved to cache
2025-12-01 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ce9d6c2-358c-537f-ae31-5824863864ff
2025-12-01 19:03:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117131404, 'registration': 'GY17CRX', 'account': 'WIL004', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 TD4 SE Tech 5dr Auto', 'mileage': 48702, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-04-24', 'fuel': 'Diesel', 'motExpiry': '2026-10-23', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GY17CRX/2025-11-17/image/c250211a-7e59-46ae-b9f7-9821ba2ce6c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/c195c5b0-711e-4c98-ac15-d02ba041a89a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/b52d7545-f7f4-459d-bfe7-14c96feeed6c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/5832d238-845c-444c-b980-de05cbd3db2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/a25139dc-6fe3-46ff-a548-b1e3ff85ab8c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/8709b038-5e9e-4be7-bc8b-802d263519dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/6192412d-cd19-4519-b2e8-d23881c4b825_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/627df8ca-6eab-4d23-8977-65defd8c6abb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/2d518c96-d513-45b4-a0ac-73772c7f8fd0_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 04/19 12K 03/21 27K', 'remarks': 'S/KEY SD', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8648b8e4-a601-49da-9cf8-c772842242fe.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117131404, 'registration': 'GY17CRX', 'account': 'WIL004', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 TD4 SE Tech 5dr Auto', 'mileage': 48702, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-04-24', 'fuel': 'Diesel', 'motExpiry': '2026-10-23', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GY17CRX/2025-11-17/image/c250211a-7e59-46ae-b9f7-9821ba2ce6c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/c195c5b0-711e-4c98-ac15-d02ba041a89a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/b52d7545-f7f4-459d-bfe7-14c96feeed6c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/5832d238-845c-444c-b980-de05cbd3db2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/a25139dc-6fe3-46ff-a548-b1e3ff85ab8c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/8709b038-5e9e-4be7-bc8b-802d263519dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/6192412d-cd19-4519-b2e8-d23881c4b825_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/627df8ca-6eab-4d23-8977-65defd8c6abb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/2d518c96-d513-45b4-a0ac-73772c7f8fd0_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 04/19 12K 03/21 27K', 'remarks': 'S/KEY SD', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8648b8e4-a601-49da-9cf8-c772842242fe.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8cb08f6-7578-50ce-b7bb-eea640cf2775 with identifier: 117131404
2025-12-01 19:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8cb08f6-7578-50ce-b7bb-eea640cf2775 with scrape type 2
2025-12-01 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8cb08f6-7578-50ce-b7bb-eea640cf2775 with scrape type 2
2025-12-01 19:03:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d8cb08f6-7578-50ce-b7bb-eea640cf2775, identifier: 117131404
2025-12-01 19:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SR18GBE/2025-12-01/image/6463ec47-ff69-4826-aedf-5ac2b35c4065_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117632517?view=catalogue)
2025-12-01 19:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/SR18GBE/2025-12-01/image/860a667e-ceeb-466f-bcc5-ebbac9c8a6e7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117632517?view=catalogue)
2025-12-01 19:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117440649?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117635092?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d8cb08f6-7578-50ce-b7bb-eea640cf2775 with identifier: 117131404
2025-12-01 19:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d8cb08f6-7578-50ce-b7bb-eea640cf2775 with identifier: 117131404
2025-12-01 19:03:39 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d8cb08f6-7578-50ce-b7bb-eea640cf2775 with identifier: 117131404 to the API
2025-12-01 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27d8cb08f6-7578-50ce-b7bb-eea640cf2775%27 HTTP/1.1" 200 None
2025-12-01 19:03:39 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id d8cb08f6-7578-50ce-b7bb-eea640cf2775: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:03:38 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:03:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117131404?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': 'd8cb08f6-7578-50ce-b7bb-eea640cf2775',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GY17CRX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117131404',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK',
 'odometer': 48702,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-24',
 'seller_name': 'Wilsons',
 'title': 'LAND ROVER RANGE ROVER EVOQUE DIESEL HATCHBACK 2.0 TD4 SE Tech 5dr '
          'Auto',
 'transmission': 'automatic',
 'trim': '2.0 TD4 SE Tech 5dr Auto',
 'vin': None,
 'year': 2017}
2025-12-01 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117131404%27 HTTP/1.1" 200 None
2025-12-01 19:03:39 [astonbarclay.gb] INFO: Saving data for 117131404: {'auction_closing_time': 1764755100.0, 'created_time': 1763060555.156275, 'last_price_update_time': 1764615819.379892}
2025-12-01 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117131404') HTTP/1.1" 204 0
2025-12-01 19:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e8aead0>
2025-12-01 19:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c34eeee2-e66c-53a2-a6bd-79ec8aa895ce/c34eeee2-e66c-53a2-a6bd-79ec8aa895ce_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSR18GBE%252F2025-12-01%252Fimage%252F667fa8c3-8d8a-4b85-b10d-df0c43337b4d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SR18GBE/2025-12-01/image/667fa8c3-8d8a-4b85-b10d-df0c43337b4d_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c34eeee2-e66c-53a2-a6bd-79ec8aa895ce
2025-12-01 19:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f50647d3410>
2025-12-01 19:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_7.jpg HTTP/1.1" 201 0
2025-12-01 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLN74OYX%252F2025-11-21%252Fimage%252Fcd47c374-aae7-4084-811f-d9d2a02f5b56_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN74OYX/2025-11-21/image/cd47c374-aae7-4084-811f-d9d2a02f5b56_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 33d7290d-cc06-57b8-b4b5-7609a19c2a74
2025-12-01 19:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LN74OYX/2025-11-21/image/ca13aae3-8ad7-4469-bf3b-38b3608d4150_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117415829?view=catalogue)
2025-12-01 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBP21VJZ%252F2025-12-01%252Fimage%252F9f50c84c-6b86-4d9f-80f1-79288ee29428_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/9f50c84c-6b86-4d9f-80f1-79288ee29428_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117288542?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e8ae910>
2025-12-01 19:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c34eeee2-e66c-53a2-a6bd-79ec8aa895ce/c34eeee2-e66c-53a2-a6bd-79ec8aa895ce_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSR18GBE%252F2025-12-01%252Fimage%252F2f415d98-1d27-4e50-b74f-d8a5a01545ce_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SR18GBE/2025-12-01/image/2f415d98-1d27-4e50-b74f-d8a5a01545ce_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c34eeee2-e66c-53a2-a6bd-79ec8aa895ce
2025-12-01 19:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e68a1d0>
2025-12-01 19:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-01 19:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ce9d6c2-358c-537f-ae31-5824863864ff/3ce9d6c2-358c-537f-ae31-5824863864ff_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fa06f617d-98c3-4967-8545-0e263709dadf.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/a06f617d-98c3-4967-8545-0e263709dadf.jpg?w=600 saved to cache
2025-12-01 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ce9d6c2-358c-537f-ae31-5824863864ff
2025-12-01 19:03:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ce9d6c2-358c-537f-ae31-5824863864ff, skipping ID generation
2025-12-01 19:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ce9d6c2-358c-537f-ae31-5824863864ff with scrape type 1
2025-12-01 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3ce9d6c2-358c-537f-ae31-5824863864ff from tracking dictionaries
2025-12-01 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ce9d6c2-358c-537f-ae31-5824863864ff sending to next pipeline
2025-12-01 19:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3ce9d6c2-358c-537f-ae31-5824863864ff, identifier: 117563683
2025-12-01 19:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3ce9d6c2-358c-537f-ae31-5824863864ff with identifier: 117563683
2025-12-01 19:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3ce9d6c2-358c-537f-ae31-5824863864ff with identifier: 117563683
2025-12-01 19:03:40 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3ce9d6c2-358c-537f-ae31-5824863864ff with identifier: 117563683 to the API
2025-12-01 19:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/a06f617d-98c3-4967-8545-0e263709dadf.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 219,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '3ce9d6c2-358c-537f-ae31-5824863864ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LV72OEE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117563683',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER VELAR ESTATE',
 'odometer': 31577,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ce9d6c2-358c-537f-ae31-5824863864ff/3ce9d6c2-358c-537f-ae31-5824863864ff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63409,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/4de15db8-5ac3-49c8-bcc0-c5ca43840708.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ce9d6c2-358c-537f-ae31-5824863864ff/3ce9d6c2-358c-537f-ae31-5824863864ff_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51588,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/08ae5c96-da23-4edf-b372-fc9da949baee.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ce9d6c2-358c-537f-ae31-5824863864ff/3ce9d6c2-358c-537f-ae31-5824863864ff_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45722,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/e0076464-fe61-4ec9-b4d6-9f2dff09cf23.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ce9d6c2-358c-537f-ae31-5824863864ff/3ce9d6c2-358c-537f-ae31-5824863864ff_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35614,
             'Height': 301,
             'OriginUrl': 'https://abimg002.imgix.net/a06f617d-98c3-4967-8545-0e263709dadf.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-22',
 'seller_name': 'Hedin Automotive BMW',
 'title': 'LAND ROVER RANGE ROVER VELAR ESTATE 2.0 P250 Edition 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 P250 Edition 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-01 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117563683%27 HTTP/1.1" 200 None
2025-12-01 19:03:41 [astonbarclay.gb] INFO: Saving data for 117563683: {'created_time': 1764615821.851668, 'last_price_update_time': 1764615821.851678, 'auction_closing_time': 1764756000.0}
2025-12-01 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117563683') HTTP/1.1" 204 0
2025-12-01 19:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e9c0710>
2025-12-01 19:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-01 19:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c34eeee2-e66c-53a2-a6bd-79ec8aa895ce/c34eeee2-e66c-53a2-a6bd-79ec8aa895ce_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSR18GBE%252F2025-12-01%252Fimage%252F4e9a8319-3cb7-4ec2-8244-18f777b181e5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SR18GBE/2025-12-01/image/4e9a8319-3cb7-4ec2-8244-18f777b181e5_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c34eeee2-e66c-53a2-a6bd-79ec8aa895ce
2025-12-01 19:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e9c9710>
2025-12-01 19:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_8.jpg HTTP/1.1" 201 0
2025-12-01 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLN74OYX%252F2025-11-21%252Fimage%252Fe52f3cee-3364-4d4f-86b3-c087cb6158b8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN74OYX/2025-11-21/image/e52f3cee-3364-4d4f-86b3-c087cb6158b8_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 33d7290d-cc06-57b8-b4b5-7609a19c2a74
2025-12-01 19:03:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117024353, 'registration': 'KJ18UDH', 'account': 'KCS002', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.5 Cooper II 5dr', 'mileage': 55760, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-10-07', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/bb33165b-5d3c-42e7-81e3-aa7932d495b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/f766b7b4-f6b3-427b-91f2-db043f15342e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/2d7f92d9-aa3e-4440-aae7-b066cf5594a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/86e2a420-d758-4d1f-a2f4-2860b86cc1d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/82ac0aed-a8db-4fa9-a6fe-76030140c08e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/b7d3b398-75f4-4fdf-8770-48be014880c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/420351c1-9807-44dd-8306-c89f7a672acc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/2f9b0f0e-dd90-452e-a73b-80d042ddd820_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/b6948e82-efa9-423d-a88c-ab71d127f9c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/c61f4a2e-0fff-4ab5-9b6c-aa7e81a1b58b_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service digital IDRIVE 04/21 15K', 'remarks': 'NO SPARE KEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 116, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d845f5a5-bdbe-4ad5-9c24-1342ba997053.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117024353, 'registration': 'KJ18UDH', 'account': 'KCS002', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.5 Cooper II 5dr', 'mileage': 55760, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-10-07', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/bb33165b-5d3c-42e7-81e3-aa7932d495b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/f766b7b4-f6b3-427b-91f2-db043f15342e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/2d7f92d9-aa3e-4440-aae7-b066cf5594a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/86e2a420-d758-4d1f-a2f4-2860b86cc1d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/82ac0aed-a8db-4fa9-a6fe-76030140c08e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/b7d3b398-75f4-4fdf-8770-48be014880c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/420351c1-9807-44dd-8306-c89f7a672acc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/2f9b0f0e-dd90-452e-a73b-80d042ddd820_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/b6948e82-efa9-423d-a88c-ab71d127f9c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/c61f4a2e-0fff-4ab5-9b6c-aa7e81a1b58b_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service digital IDRIVE 04/21 15K', 'remarks': 'NO SPARE KEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 116, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d845f5a5-bdbe-4ad5-9c24-1342ba997053.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9502caad-ffbb-55ee-8b5d-4a3906815fe5 with identifier: 117024353
2025-12-01 19:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9502caad-ffbb-55ee-8b5d-4a3906815fe5 with scrape type 2
2025-12-01 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9502caad-ffbb-55ee-8b5d-4a3906815fe5 with scrape type 2
2025-12-01 19:03:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9502caad-ffbb-55ee-8b5d-4a3906815fe5, identifier: 117024353
2025-12-01 19:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/5dd995d3-b1f3-4832-9f07-de0fc1c98448_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117633088?view=catalogue)
2025-12-01 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBP21VJZ%252F2025-12-01%252Fimage%252F80abf68f-e1bc-4789-9137-4f20d11ef084_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/80abf68f-e1bc-4789-9137-4f20d11ef084_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9502caad-ffbb-55ee-8b5d-4a3906815fe5 with identifier: 117024353
2025-12-01 19:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9502caad-ffbb-55ee-8b5d-4a3906815fe5 with identifier: 117024353
2025-12-01 19:03:42 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9502caad-ffbb-55ee-8b5d-4a3906815fe5 with identifier: 117024353 to the API
2025-12-01 19:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%279502caad-ffbb-55ee-8b5d-4a3906815fe5%27 HTTP/1.1" 200 None
2025-12-01 19:03:42 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 9502caad-ffbb-55ee-8b5d-4a3906815fe5: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:03:41 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:03:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117024353?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '9502caad-ffbb-55ee-8b5d-4a3906815fe5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KJ18UDH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117024353',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'MINI',
 'model': 'HATCHBACK',
 'odometer': 55760,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-30',
 'seller_name': 'TCB Group - Prime',
 'title': 'MINI HATCHBACK 1.5 Cooper II 5dr',
 'transmission': 'manual',
 'trim': '1.5 Cooper II 5dr',
 'vin': None,
 'year': 2018}
2025-12-01 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024353%27 HTTP/1.1" 200 None
2025-12-01 19:03:42 [astonbarclay.gb] INFO: Saving data for 117024353: {'auction_closing_time': 1764755100.0, 'created_time': 1762455731.028291, 'last_price_update_time': 1764615822.820863}
2025-12-01 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117024353') HTTP/1.1" 204 0
2025-12-01 19:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e426150>
2025-12-01 19:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c34eeee2-e66c-53a2-a6bd-79ec8aa895ce/c34eeee2-e66c-53a2-a6bd-79ec8aa895ce_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSR18GBE%252F2025-12-01%252Fimage%252F6463ec47-ff69-4826-aedf-5ac2b35c4065_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SR18GBE/2025-12-01/image/6463ec47-ff69-4826-aedf-5ac2b35c4065_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c34eeee2-e66c-53a2-a6bd-79ec8aa895ce
2025-12-01 19:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e68ed90>
2025-12-01 19:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c34eeee2-e66c-53a2-a6bd-79ec8aa895ce/c34eeee2-e66c-53a2-a6bd-79ec8aa895ce_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FSR18GBE%252F2025-12-01%252Fimage%252F860a667e-ceeb-466f-bcc5-ebbac9c8a6e7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/SR18GBE/2025-12-01/image/860a667e-ceeb-466f-bcc5-ebbac9c8a6e7_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c34eeee2-e66c-53a2-a6bd-79ec8aa895ce
2025-12-01 19:03:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c34eeee2-e66c-53a2-a6bd-79ec8aa895ce, skipping ID generation
2025-12-01 19:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c34eeee2-e66c-53a2-a6bd-79ec8aa895ce with scrape type 1
2025-12-01 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c34eeee2-e66c-53a2-a6bd-79ec8aa895ce from tracking dictionaries
2025-12-01 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c34eeee2-e66c-53a2-a6bd-79ec8aa895ce sending to next pipeline
2025-12-01 19:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c34eeee2-e66c-53a2-a6bd-79ec8aa895ce, identifier: 117632517
2025-12-01 19:03:43 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117440649, 'registration': 'SO17CRK', 'account': 'KCS002', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T N-Connecta 5dr', 'mileage': 48372, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-07-31', 'fuel': 'Petrol', 'motExpiry': '2026-06-23', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SO17CRK/2025-11-24/image/0bcf6513-a26d-4e31-b74f-2795fe1b8388_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/eceff26c-fe67-406c-9c17-0eac29bb3a0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/243a4c7e-cf03-4cb9-801f-fe825965c687_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/a7bf0d57-d72a-44ec-9e55-08c7934f3c44_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/12366d04-2217-44bd-b0d1-d52c13e7347f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/6d8e7889-e47b-43af-a7ed-8d92364094ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/96756350-38e9-41e3-b030-113d1d52d173_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/8aa258c9-5613-4605-b576-e4faf0f9670a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/13e9631f-84ad-4f79-a49e-f3b40e0f42ab_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 07/18 8K 08/19 16K 08/20 23K 06/21 29K 06/22 34K 06/23 39K 07/24 42K 06/25 46K', 'remarks': 'S/KEY SD', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3ccde17e-936a-4a61-897b-c8b08677494c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:43 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117440649, 'registration': 'SO17CRK', 'account': 'KCS002', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T N-Connecta 5dr', 'mileage': 48372, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-07-31', 'fuel': 'Petrol', 'motExpiry': '2026-06-23', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SO17CRK/2025-11-24/image/0bcf6513-a26d-4e31-b74f-2795fe1b8388_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/eceff26c-fe67-406c-9c17-0eac29bb3a0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/243a4c7e-cf03-4cb9-801f-fe825965c687_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/a7bf0d57-d72a-44ec-9e55-08c7934f3c44_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/12366d04-2217-44bd-b0d1-d52c13e7347f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/6d8e7889-e47b-43af-a7ed-8d92364094ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/96756350-38e9-41e3-b030-113d1d52d173_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/8aa258c9-5613-4605-b576-e4faf0f9670a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO17CRK/2025-11-24/image/13e9631f-84ad-4f79-a49e-f3b40e0f42ab_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 07/18 8K 08/19 16K 08/20 23K 06/21 29K 06/22 34K 06/23 39K 07/24 42K 06/25 46K', 'remarks': 'S/KEY SD', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3ccde17e-936a-4a61-897b-c8b08677494c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d0e8942-083c-5a53-9327-d76572ff43bc with identifier: 117440649
2025-12-01 19:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d0e8942-083c-5a53-9327-d76572ff43bc with scrape type 2
2025-12-01 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d0e8942-083c-5a53-9327-d76572ff43bc with scrape type 2
2025-12-01 19:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8d0e8942-083c-5a53-9327-d76572ff43bc, identifier: 117440649
2025-12-01 19:03:43 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117635092, 'registration': 'NL16KHJ', 'account': 'KCS002', 'make': 'VAUXHALL', 'model': 'VIVA HATCHBACK', 'derivative': '1.0 SE 5dr [A/C]', 'mileage': 76192, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-03-29', 'fuel': 'Petrol', 'motExpiry': '2025-11-10', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 104, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/95a3cff9-7b95-4239-b7aa-8a92e6e86c2c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:43 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117635092, 'registration': 'NL16KHJ', 'account': 'KCS002', 'make': 'VAUXHALL', 'model': 'VIVA HATCHBACK', 'derivative': '1.0 SE 5dr [A/C]', 'mileage': 76192, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-03-29', 'fuel': 'Petrol', 'motExpiry': '2025-11-10', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 104, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/95a3cff9-7b95-4239-b7aa-8a92e6e86c2c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44b627e8-b080-5c19-bc41-e7f99e4bdea1 with identifier: 117635092
2025-12-01 19:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44b627e8-b080-5c19-bc41-e7f99e4bdea1 with scrape type 1
2025-12-01 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 44b627e8-b080-5c19-bc41-e7f99e4bdea1
2025-12-01 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 44b627e8-b080-5c19-bc41-e7f99e4bdea1
2025-12-01 19:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 44b627e8-b080-5c19-bc41-e7f99e4bdea1, identifier: 117635092
2025-12-01 19:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117440690?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c34eeee2-e66c-53a2-a6bd-79ec8aa895ce with identifier: 117632517
2025-12-01 19:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c34eeee2-e66c-53a2-a6bd-79ec8aa895ce with identifier: 117632517
2025-12-01 19:03:43 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: c34eeee2-e66c-53a2-a6bd-79ec8aa895ce with expiration date: 2025-12-01T17:30:00Z
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-01T17:30:00Z',
 'fuel_type': 'Diesel',
 'id': 'c34eeee2-e66c-53a2-a6bd-79ec8aa895ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SR18GBE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117632517',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'FIESTA DIESEL HATCHBACK',
 'odometer': 66353,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c34eeee2-e66c-53a2-a6bd-79ec8aa895ce/c34eeee2-e66c-53a2-a6bd-79ec8aa895ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37540,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SR18GBE/2025-12-01/image/c35a27b3-6085-4f6d-9a88-b702803029de_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c34eeee2-e66c-53a2-a6bd-79ec8aa895ce/c34eeee2-e66c-53a2-a6bd-79ec8aa895ce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36477,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SR18GBE/2025-12-01/image/6463ec47-ff69-4826-aedf-5ac2b35c4065_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c34eeee2-e66c-53a2-a6bd-79ec8aa895ce/c34eeee2-e66c-53a2-a6bd-79ec8aa895ce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35264,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SR18GBE/2025-12-01/image/860a667e-ceeb-466f-bcc5-ebbac9c8a6e7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c34eeee2-e66c-53a2-a6bd-79ec8aa895ce/c34eeee2-e66c-53a2-a6bd-79ec8aa895ce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32102,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SR18GBE/2025-12-01/image/4e9a8319-3cb7-4ec2-8244-18f777b181e5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c34eeee2-e66c-53a2-a6bd-79ec8aa895ce/c34eeee2-e66c-53a2-a6bd-79ec8aa895ce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48974,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SR18GBE/2025-12-01/image/2f415d98-1d27-4e50-b74f-d8a5a01545ce_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c34eeee2-e66c-53a2-a6bd-79ec8aa895ce/c34eeee2-e66c-53a2-a6bd-79ec8aa895ce_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40479,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SR18GBE/2025-12-01/image/667fa8c3-8d8a-4b85-b10d-df0c43337b4d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c34eeee2-e66c-53a2-a6bd-79ec8aa895ce/c34eeee2-e66c-53a2-a6bd-79ec8aa895ce_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32456,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/SR18GBE/2025-12-01/image/ebf1de41-86ac-48e1-b595-f34af535f90c_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-30',
 'seller_name': 'Manamanx Ltd',
 'title': 'FORD FIESTA DIESEL HATCHBACK 1.5 TDCi Zetec 5dr',
 'transmission': 'manual',
 'trim': '1.5 TDCi Zetec 5dr',
 'vin': None,
 'year': 2018}
2025-12-01 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117632517%27 HTTP/1.1" 200 None
2025-12-01 19:03:43 [astonbarclay.gb] INFO: Saving data for 117632517: {'created_time': 1764615823.626436, 'last_price_update_time': 1764615823.626445, 'auction_closing_time': 1764610200.0}
2025-12-01 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117632517') HTTP/1.1" 204 0
2025-12-01 19:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8d0e8942-083c-5a53-9327-d76572ff43bc with identifier: 117440649
2025-12-01 19:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8d0e8942-083c-5a53-9327-d76572ff43bc with identifier: 117440649
2025-12-01 19:03:43 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 8d0e8942-083c-5a53-9327-d76572ff43bc with identifier: 117440649 to the API
2025-12-01 19:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%278d0e8942-083c-5a53-9327-d76572ff43bc%27 HTTP/1.1" 200 None
2025-12-01 19:03:43 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 8d0e8942-083c-5a53-9327-d76572ff43bc: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:03:42 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:03:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117440649?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '8d0e8942-083c-5a53-9327-d76572ff43bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SO17CRK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117440649',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 48372,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-31',
 'seller_name': 'TCB Group - Prime',
 'title': 'NISSAN QASHQAI HATCHBACK 1.2 DiG-T N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '1.2 DiG-T N-Connecta 5dr',
 'vin': None,
 'year': 2017}
2025-12-01 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117440649%27 HTTP/1.1" 200 None
2025-12-01 19:03:43 [astonbarclay.gb] INFO: Saving data for 117440649: {'auction_closing_time': 1764755100.0, 'created_time': 1763974954.39675, 'last_price_update_time': 1764615823.926854}
2025-12-01 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117440649') HTTP/1.1" 204 0
2025-12-01 19:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 44b627e8-b080-5c19-bc41-e7f99e4bdea1 with identifier: 117635092
2025-12-01 19:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 44b627e8-b080-5c19-bc41-e7f99e4bdea1 with identifier: 117635092
2025-12-01 19:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 44b627e8-b080-5c19-bc41-e7f99e4bdea1 with identifier: 117635092 to the API
2025-12-01 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2744b627e8-b080-5c19-bc41-e7f99e4bdea1%27 HTTP/1.1" 200 None
2025-12-01 19:03:44 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 44b627e8-b080-5c19-bc41-e7f99e4bdea1: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:03:43 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117635092?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '44b627e8-b080-5c19-bc41-e7f99e4bdea1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NL16KHJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117635092',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'VAUXHALL',
 'model': 'VIVA HATCHBACK',
 'odometer': 76192,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-29',
 'seller_name': 'TCB Group - Prime',
 'title': 'VAUXHALL VIVA HATCHBACK 1.0 SE 5dr [A/C]',
 'transmission': 'manual',
 'trim': '1.0 SE 5dr [A/C]',
 'vin': None,
 'year': 2016}
2025-12-01 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117635092%27 HTTP/1.1" 200 None
2025-12-01 19:03:44 [astonbarclay.gb] INFO: Saving data for 117635092: {'created_time': 1764615824.210268, 'last_price_update_time': 1764615824.210278, 'auction_closing_time': 1764755100.0}
2025-12-01 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117635092') HTTP/1.1" 204 0
2025-12-01 19:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e534f10>
2025-12-01 19:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_9.jpg HTTP/1.1" 201 0
2025-12-01 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLN74OYX%252F2025-11-21%252Fimage%252Fca13aae3-8ad7-4469-bf3b-38b3608d4150_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LN74OYX/2025-11-21/image/ca13aae3-8ad7-4469-bf3b-38b3608d4150_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 33d7290d-cc06-57b8-b4b5-7609a19c2a74
2025-12-01 19:03:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 33d7290d-cc06-57b8-b4b5-7609a19c2a74, skipping ID generation
2025-12-01 19:03:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33d7290d-cc06-57b8-b4b5-7609a19c2a74 with scrape type 1
2025-12-01 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 33d7290d-cc06-57b8-b4b5-7609a19c2a74 from tracking dictionaries
2025-12-01 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 33d7290d-cc06-57b8-b4b5-7609a19c2a74 sending to next pipeline
2025-12-01 19:03:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 33d7290d-cc06-57b8-b4b5-7609a19c2a74, identifier: 117415829
2025-12-01 19:03:44 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117288542, 'registration': 'KR69FEF', 'account': 'KCS002', 'make': 'DS', 'model': 'DS 3 DIESEL CROSSBACK HATCHBACK (RC)', 'derivative': '1.5 BlueHDi Prestige 5dr', 'mileage': 59307, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-10-30', 'fuel': 'Diesel', 'motExpiry': '2026-03-06', 'doors': 5, 'engineSize': 1500, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KR69FEF/2025-11-18/image/5fc3ff04-f398-4285-b5fb-bb5c2828a406_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/82526bb9-5bd4-4632-984f-5c401d7d0c88_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/00fe4a7f-54dc-4dda-a46e-8b7dc271ce0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/64807544-65c0-4bc0-ae42-79ef9ab4cf36_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/c3bab845-d629-41a8-87a5-71e5c3165e0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/c9238d51-bd82-4b49-98f7-545d4cd1ce9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/38495995-9694-49c1-b88e-75d619664455_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/c2eae0d7-6b92-4b00-b9c3-22a4af31d163_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/0b5ce54f-8971-415d-90c9-b914ea23dd0f_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 05/21 8K 12/24 50K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 97, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/705f02f4-e35e-4a5e-ba1b-49c0b0a6b704.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:44 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117288542, 'registration': 'KR69FEF', 'account': 'KCS002', 'make': 'DS', 'model': 'DS 3 DIESEL CROSSBACK HATCHBACK (RC)', 'derivative': '1.5 BlueHDi Prestige 5dr', 'mileage': 59307, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-10-30', 'fuel': 'Diesel', 'motExpiry': '2026-03-06', 'doors': 5, 'engineSize': 1500, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KR69FEF/2025-11-18/image/5fc3ff04-f398-4285-b5fb-bb5c2828a406_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/82526bb9-5bd4-4632-984f-5c401d7d0c88_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/00fe4a7f-54dc-4dda-a46e-8b7dc271ce0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/64807544-65c0-4bc0-ae42-79ef9ab4cf36_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/c3bab845-d629-41a8-87a5-71e5c3165e0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/c9238d51-bd82-4b49-98f7-545d4cd1ce9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/38495995-9694-49c1-b88e-75d619664455_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/c2eae0d7-6b92-4b00-b9c3-22a4af31d163_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/0b5ce54f-8971-415d-90c9-b914ea23dd0f_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 05/21 8K 12/24 50K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 97, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/705f02f4-e35e-4a5e-ba1b-49c0b0a6b704.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 306f4428-c66b-5c17-b51a-aa7299ec0e4f with identifier: 117288542
2025-12-01 19:03:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 306f4428-c66b-5c17-b51a-aa7299ec0e4f with scrape type 2
2025-12-01 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 306f4428-c66b-5c17-b51a-aa7299ec0e4f with scrape type 2
2025-12-01 19:03:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 306f4428-c66b-5c17-b51a-aa7299ec0e4f, identifier: 117288542
2025-12-01 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/54c4e76f-e1e0-47a7-a823-1d3afe54029b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117633088?view=catalogue)
2025-12-01 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBP21VJZ%252F2025-12-01%252Fimage%252Fb96c9726-60c0-4a1c-bc0c-0c5b30877255_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/b96c9726-60c0-4a1c-bc0c-0c5b30877255_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117131446?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:03:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 33d7290d-cc06-57b8-b4b5-7609a19c2a74 with identifier: 117415829
2025-12-01 19:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 33d7290d-cc06-57b8-b4b5-7609a19c2a74 with identifier: 117415829
2025-12-01 19:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 10, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'volkswagen id.4 estate 210kw match pro 77kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'id.4 estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 16458, 'odometer_reading_unit': 'mi', 'registration_date': '2024-12-12', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117415829', 'expiration_date': '2025-12-15t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '210kw match pro 77kwh 5dr auto', 'license_plate': 'ln74oyx', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '33d7290d-cc06-57b8-b4b5-7609a19c2a74', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/7ba24871-2e5a-429b-9687-b74eae7434b6_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33442}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/0fde4743-98cb-4b3a-8d50-3304d420ab80_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31686}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/17c67160-5a92-4b68-803c-a35b8458a4e5_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33577}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/327c4776-009a-4e39-9e86-72d89206f227_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34539}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/e93add83-58a4-49db-a2ca-00d5196bc0cf_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 35912}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/c0e0bc52-b7c5-431d-bc79-90b76400df49_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 46427}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/9f80509d-ef47-42e4-aa07-c83131fa59d9_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 52955}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/cd47c374-aae7-4084-811f-d9d2a02f5b56_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 53170}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/e52f3cee-3364-4d4f-86b3-c087cb6158b8_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 48140}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/ca13aae3-8ad7-4469-bf3b-38b3608d4150_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 42369}], 'current_year_diff': 1, 'age_in_months': 11, 'make_model': 'volkswagen id.4 estate', 'sanitized_make': 'volkswagen', 'odometer_in_km': 26486} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 11,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-15t10:00:00z',
     'fuel_type': 'electric',
     'id': '33d7290d-cc06-57b8-b4b5-7609a19c2a74',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'ln74oyx',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117415829',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'volkswagen',
     'make_model': 'volkswagen id.4 estate',
     'model': 'id.4 estate',
     'odometer': 16458,
     'odometer_in_km': 26486,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 10,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33442,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/7ba24871-2e5a-429b-9687-b74eae7434b6_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31686,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/0fde4743-98cb-4b3a-8d50-3304d420ab80_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33577,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/17c67160-5a92-4b68-803c-a35b8458a4e5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34539,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/327c4776-009a-4e39-9e86-72d89206f227_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 35912,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/e93add83-58a4-49db-a2ca-00d5196bc0cf_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46427,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/c0e0bc52-b7c5-431d-bc79-90b76400df49_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52955,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/9f80509d-ef47-42e4-aa07-c83131fa59d9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 53170,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/cd47c374-aae7-4084-811f-d9d2a02f5b56_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48140,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/e52f3cee-3364-4d4f-86b3-c087cb6158b8_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 42369,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/ca13aae3-8ad7-4469-bf3b-38b3608d4150_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-12-12',
     'sanitized_make': 'volkswagen',
     'seller_name': 'motability operations',
     'title': 'volkswagen id.4 estate 210kw match pro 77kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '210kw match pro 77kwh 5dr auto',
     'vin': None,
     'year': 2024}
2025-12-01 19:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 33d7290d-cc06-57b8-b4b5-7609a19c2a74 spider: astonbarclay.gb
2025-12-01 19:03:44 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 33d7290d-cc06-57b8-b4b5-7609a19c2a74 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 10, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'volkswagen id.4 estate 210kw match pro 77kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'id.4 estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 16458, 'odometer_reading_unit': 'mi', 'registration_date': '2024-12-12', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117415829', 'expiration_date': '2025-12-15t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '210kw match pro 77kwh 5dr auto', 'license_plate': 'ln74oyx', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '33d7290d-cc06-57b8-b4b5-7609a19c2a74', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/7ba24871-2e5a-429b-9687-b74eae7434b6_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33442}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/0fde4743-98cb-4b3a-8d50-3304d420ab80_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 31686}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/17c67160-5a92-4b68-803c-a35b8458a4e5_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33577}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/327c4776-009a-4e39-9e86-72d89206f227_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34539}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/e93add83-58a4-49db-a2ca-00d5196bc0cf_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 35912}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/c0e0bc52-b7c5-431d-bc79-90b76400df49_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 46427}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/9f80509d-ef47-42e4-aa07-c83131fa59d9_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 52955}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/cd47c374-aae7-4084-811f-d9d2a02f5b56_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 53170}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/e52f3cee-3364-4d4f-86b3-c087cb6158b8_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 48140}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/ca13aae3-8ad7-4469-bf3b-38b3608d4150_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 42369}], 'current_year_diff': 1, 'age_in_months': 11, 'make_model': 'volkswagen id.4 estate', 'sanitized_make': 'volkswagen', 'odometer_in_km': 26486} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 11,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-15t10:00:00z',
     'fuel_type': 'electric',
     'id': '33d7290d-cc06-57b8-b4b5-7609a19c2a74',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'ln74oyx',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117415829',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'volkswagen',
     'make_model': 'volkswagen id.4 estate',
     'model': 'id.4 estate',
     'odometer': 16458,
     'odometer_in_km': 26486,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 10,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33442,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/7ba24871-2e5a-429b-9687-b74eae7434b6_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 31686,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/0fde4743-98cb-4b3a-8d50-3304d420ab80_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33577,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/17c67160-5a92-4b68-803c-a35b8458a4e5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34539,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/327c4776-009a-4e39-9e86-72d89206f227_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 35912,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/e93add83-58a4-49db-a2ca-00d5196bc0cf_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46427,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/c0e0bc52-b7c5-431d-bc79-90b76400df49_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 52955,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/9f80509d-ef47-42e4-aa07-c83131fa59d9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 53170,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/cd47c374-aae7-4084-811f-d9d2a02f5b56_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48140,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/e52f3cee-3364-4d4f-86b3-c087cb6158b8_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 42369,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/ca13aae3-8ad7-4469-bf3b-38b3608d4150_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-12-12',
     'sanitized_make': 'volkswagen',
     'seller_name': 'motability operations',
     'title': 'volkswagen id.4 estate 210kw match pro 77kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '210kw match pro 77kwh 5dr auto',
     'vin': None,
     'year': 2024}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '33d7290d-cc06-57b8-b4b5-7609a19c2a74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LN74OYX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117415829',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'ID.4 ESTATE',
 'odometer': 16458,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33442,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/7ba24871-2e5a-429b-9687-b74eae7434b6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31686,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/0fde4743-98cb-4b3a-8d50-3304d420ab80_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33577,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/17c67160-5a92-4b68-803c-a35b8458a4e5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34539,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/327c4776-009a-4e39-9e86-72d89206f227_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35912,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/e93add83-58a4-49db-a2ca-00d5196bc0cf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46427,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/c0e0bc52-b7c5-431d-bc79-90b76400df49_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52955,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/9f80509d-ef47-42e4-aa07-c83131fa59d9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53170,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/cd47c374-aae7-4084-811f-d9d2a02f5b56_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48140,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/e52f3cee-3364-4d4f-86b3-c087cb6158b8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d7290d-cc06-57b8-b4b5-7609a19c2a74/33d7290d-cc06-57b8-b4b5-7609a19c2a74_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42369,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LN74OYX/2025-11-21/image/ca13aae3-8ad7-4469-bf3b-38b3608d4150_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-12',
 'seller_name': 'Motability Operations',
 'title': 'VOLKSWAGEN ID.4 ESTATE 210kW Match Pro 77kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '210kW Match Pro 77kWh 5dr Auto',
 'vin': None,
 'year': 2024}
2025-12-01 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117415829%27 HTTP/1.1" 200 None
2025-12-01 19:03:44 [astonbarclay.gb] INFO: Saving data for 117415829: {'created_time': 1764615824.87923, 'last_price_update_time': 1764615824.879242, 'auction_closing_time': 1765792800.0}
2025-12-01 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117415829') HTTP/1.1" 204 0
2025-12-01 19:03:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 306f4428-c66b-5c17-b51a-aa7299ec0e4f with identifier: 117288542
2025-12-01 19:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 306f4428-c66b-5c17-b51a-aa7299ec0e4f with identifier: 117288542
2025-12-01 19:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 306f4428-c66b-5c17-b51a-aa7299ec0e4f with identifier: 117288542 to the API
2025-12-01 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27306f4428-c66b-5c17-b51a-aa7299ec0e4f%27 HTTP/1.1" 200 None
2025-12-01 19:03:45 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 306f4428-c66b-5c17-b51a-aa7299ec0e4f: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:03:44 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117288542?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '306f4428-c66b-5c17-b51a-aa7299ec0e4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KR69FEF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117288542',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'DS',
 'model': 'DS 3 DIESEL CROSSBACK HATCHBACK (RC)',
 'odometer': 59307,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-30',
 'seller_name': 'TCB Group - Prime',
 'title': 'DS DS 3 DIESEL CROSSBACK HATCHBACK (RC) 1.5 BlueHDi Prestige 5dr',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi Prestige 5dr',
 'vin': None,
 'year': 2019}
2025-12-01 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117288542%27 HTTP/1.1" 200 None
2025-12-01 19:03:45 [astonbarclay.gb] INFO: Saving data for 117288542: {'auction_closing_time': 1764755100.0, 'created_time': 1763456461.330598, 'last_price_update_time': 1764615825.306191}
2025-12-01 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117288542') HTTP/1.1" 204 0
2025-12-01 19:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e621010>
2025-12-01 19:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_034ce54f-db67-523a-be2a-d5bd40f6f22c/034ce54f-db67-523a-be2a-d5bd40f6f22c_image_0.jpg HTTP/1.1" 201 0
2025-12-01 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBP21VJZ%252F2025-12-01%252Fimage%252F5dd995d3-b1f3-4832-9f07-de0fc1c98448_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/5dd995d3-b1f3-4832-9f07-de0fc1c98448_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 034ce54f-db67-523a-be2a-d5bd40f6f22c
2025-12-01 19:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/9f50c84c-6b86-4d9f-80f1-79288ee29428_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117633088?view=catalogue)
2025-12-01 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBP21VJZ%252F2025-12-01%252Fimage%252Fb30108c0-5021-4ace-b3c0-ac4c49294250_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-01 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/b30108c0-5021-4ace-b3c0-ac4c49294250_removebg.jpg?w=600 not downloaded yet
2025-12-01 19:03:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117440690, 'registration': 'SO19CYF', 'account': 'KCS002', 'make': 'HYUNDAI', 'model': 'I800 DIESEL ESTATE', 'derivative': '2.5 CRDi SE Nav 5dr', 'mileage': 85554, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-05-23', 'fuel': 'Diesel', 'motExpiry': '2026-11-17', 'doors': 5, 'engineSize': 2497, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SO19CYF/2025-11-24/image/5fd3fe85-2d8b-4151-8a70-893864948ada_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/a95a7948-2d4b-45a1-82d0-f4683bfa26f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/afde87ce-3d30-4e4c-aca5-170fcccf9cf7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/ca2285f1-376e-4277-829f-24a1a74770dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/005f9c80-ed26-4dd5-9889-bb9b8dc40f2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/7e8262bf-8428-4153-825d-fbeffc9998b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/0480595d-c5e5-4167-ab3f-3537bc1c1a34_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/ff5e7bce-9c77-49af-9bea-4be21f14b712_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/c4ee2993-ce41-48c7-977f-d4ca32e53527_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 2 X SB 08/20 25K 08/21 45K 04/22 60K 10/23 70K', 'remarks': 'S/KEY SD', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 222, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5e6b2d25-d8e4-4dc6-a7c8-229f77d460c2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117440690, 'registration': 'SO19CYF', 'account': 'KCS002', 'make': 'HYUNDAI', 'model': 'I800 DIESEL ESTATE', 'derivative': '2.5 CRDi SE Nav 5dr', 'mileage': 85554, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-05-23', 'fuel': 'Diesel', 'motExpiry': '2026-11-17', 'doors': 5, 'engineSize': 2497, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SO19CYF/2025-11-24/image/5fd3fe85-2d8b-4151-8a70-893864948ada_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/a95a7948-2d4b-45a1-82d0-f4683bfa26f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/afde87ce-3d30-4e4c-aca5-170fcccf9cf7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/ca2285f1-376e-4277-829f-24a1a74770dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/005f9c80-ed26-4dd5-9889-bb9b8dc40f2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/7e8262bf-8428-4153-825d-fbeffc9998b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/0480595d-c5e5-4167-ab3f-3537bc1c1a34_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/ff5e7bce-9c77-49af-9bea-4be21f14b712_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/c4ee2993-ce41-48c7-977f-d4ca32e53527_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 2 X SB 08/20 25K 08/21 45K 04/22 60K 10/23 70K', 'remarks': 'S/KEY SD', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 222, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5e6b2d25-d8e4-4dc6-a7c8-229f77d460c2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0505eef-8935-5965-96f3-60a649d896ef with identifier: 117440690
2025-12-01 19:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0505eef-8935-5965-96f3-60a649d896ef with scrape type 2
2025-12-01 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0505eef-8935-5965-96f3-60a649d896ef with scrape type 2
2025-12-01 19:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b0505eef-8935-5965-96f3-60a649d896ef, identifier: 117440690
2025-12-01 19:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b0505eef-8935-5965-96f3-60a649d896ef with identifier: 117440690
2025-12-01 19:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b0505eef-8935-5965-96f3-60a649d896ef with identifier: 117440690
2025-12-01 19:03:45 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b0505eef-8935-5965-96f3-60a649d896ef with identifier: 117440690 to the API
2025-12-01 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-01 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27b0505eef-8935-5965-96f3-60a649d896ef%27 HTTP/1.1" 200 None
2025-12-01 19:03:45 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id b0505eef-8935-5965-96f3-60a649d896ef: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Mon, 01 Dec 2025 19:03:44 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-01 19:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117440690?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 222,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': 'b0505eef-8935-5965-96f3-60a649d896ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SO19CYF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117440690',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'HYUNDAI',
 'model': 'I800 DIESEL ESTATE',
 'odometer': 85554,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-23',
 'seller_name': 'TCB Group - Prime',
 'title': 'HYUNDAI I800 DIESEL ESTATE 2.5 CRDi SE Nav 5dr',
 'transmission': 'manual',
 'trim': '2.5 CRDi SE Nav 5dr',
 'vin': None,
 'year': 2019}
2025-12-01 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117440690%27 HTTP/1.1" 200 None
2025-12-01 19:03:45 [astonbarclay.gb] INFO: Saving data for 117440690: {'auction_closing_time': 1764755100.0, 'created_time': 1763974953.893626, 'last_price_update_time': 1764615825.936749}
2025-12-01 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117440690') HTTP/1.1" 204 0
2025-12-01 19:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e836950>
2025-12-01 19:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-01 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_034ce54f-db67-523a-be2a-d5bd40f6f22c/034ce54f-db67-523a-be2a-d5bd40f6f22c_image_1.jpg HTTP/1.1" 201 0
2025-12-01 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBP21VJZ%252F2025-12-01%252Fimage%252F54c4e76f-e1e0-47a7-a823-1d3afe54029b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/54c4e76f-e1e0-47a7-a823-1d3afe54029b_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 034ce54f-db67-523a-be2a-d5bd40f6f22c
2025-12-01 19:03:46 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117131446, 'registration': 'MV20KJO', 'account': 'WIL004', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Performance AWD 4dr [Performance Upgrade] Auto', 'mileage': 95232, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2020-03-07', 'fuel': 'Electric', 'motExpiry': '2026-09-11', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MV20KJO/2025-11-17/image/b102b27e-6f98-4242-a1e9-2f2908dcb728_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/faa48bbf-32e3-46cd-9f96-27cf2273a2c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/7406a0ad-e4b0-4b86-9cd3-76c24ba64801_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/db2f2ab1-e95f-4f2d-97d8-18efa2349584_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/43ffac0c-09a6-479b-8065-79b269a9f2f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/743407a9-8c79-4f68-9a86-9649c0dbe0e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/77576649-d0d5-457c-b82b-2ae6e60cfd5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/3cc0635e-e764-4a90-81de-f3c485d5ed5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/c12ca258-c37c-45ed-b365-a6226078d822_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/c6414832-9f50-40b7-9be9-8a03befd5057_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/99dfce62-0286-4635-b86e-094324d935fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/ffe248b1-e140-46fe-8fa1-e35a320b63df_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dc16c717-2d19-4b17-8b97-00dfc5a80826.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:46 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117131446, 'registration': 'MV20KJO', 'account': 'WIL004', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Performance AWD 4dr [Performance Upgrade] Auto', 'mileage': 95232, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2020-03-07', 'fuel': 'Electric', 'motExpiry': '2026-09-11', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MV20KJO/2025-11-17/image/b102b27e-6f98-4242-a1e9-2f2908dcb728_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/faa48bbf-32e3-46cd-9f96-27cf2273a2c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/7406a0ad-e4b0-4b86-9cd3-76c24ba64801_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/db2f2ab1-e95f-4f2d-97d8-18efa2349584_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/43ffac0c-09a6-479b-8065-79b269a9f2f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/743407a9-8c79-4f68-9a86-9649c0dbe0e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/77576649-d0d5-457c-b82b-2ae6e60cfd5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/3cc0635e-e764-4a90-81de-f3c485d5ed5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/c12ca258-c37c-45ed-b365-a6226078d822_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/c6414832-9f50-40b7-9be9-8a03befd5057_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/99dfce62-0286-4635-b86e-094324d935fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/ffe248b1-e140-46fe-8fa1-e35a320b63df_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dc16c717-2d19-4b17-8b97-00dfc5a80826.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6a0a924-e876-5ad9-84ea-9e09cfa9c039 with identifier: 117131446
2025-12-01 19:03:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6a0a924-e876-5ad9-84ea-9e09cfa9c039 with scrape type 2
2025-12-01 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6a0a924-e876-5ad9-84ea-9e09cfa9c039 with scrape type 2
2025-12-01 19:03:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d6a0a924-e876-5ad9-84ea-9e09cfa9c039, identifier: 117131446
2025-12-01 19:03:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d6a0a924-e876-5ad9-84ea-9e09cfa9c039 with identifier: 117131446
2025-12-01 19:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d6a0a924-e876-5ad9-84ea-9e09cfa9c039 with identifier: 117131446
2025-12-01 19:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 153260 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153260
2025-12-01 19:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d6a0a924-e876-5ad9-84ea-9e09cfa9c039 spider: astonbarclay.gb
2025-12-01 19:03:46 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: d6a0a924-e876-5ad9-84ea-9e09cfa9c039 due to rule: high_mileage_for_country.json, error: 153260 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153260
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Electric',
 'id': 'd6a0a924-e876-5ad9-84ea-9e09cfa9c039',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MV20KJO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117131446',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'TESLA',
 'model': 'MODEL 3 SALOON',
 'odometer': 95232,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-07',
 'seller_name': 'Wilsons',
 'title': 'TESLA MODEL 3 SALOON Performance AWD 4dr [Performance Upgrade] Auto',
 'transmission': 'automatic',
 'trim': 'Performance AWD 4dr [Performance Upgrade] Auto',
 'vin': None,
 'year': 2020}
2025-12-01 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117131446%27 HTTP/1.1" 200 None
2025-12-01 19:03:46 [astonbarclay.gb] INFO: Saving data for 117131446: {'auction_closing_time': 1764755100.0, 'created_time': 1763060550.303965, 'last_price_update_time': 1764615826.511405}
2025-12-01 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117131446') HTTP/1.1" 204 0
2025-12-01 19:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/80abf68f-e1bc-4789-9137-4f20d11ef084_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117633088?view=catalogue)
2025-12-01 19:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e9f7fd0>
2025-12-01 19:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-01 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_034ce54f-db67-523a-be2a-d5bd40f6f22c/034ce54f-db67-523a-be2a-d5bd40f6f22c_image_2.jpg HTTP/1.1" 201 0
2025-12-01 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBP21VJZ%252F2025-12-01%252Fimage%252F9f50c84c-6b86-4d9f-80f1-79288ee29428_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/9f50c84c-6b86-4d9f-80f1-79288ee29428_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 034ce54f-db67-523a-be2a-d5bd40f6f22c
2025-12-01 19:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/b96c9726-60c0-4a1c-bc0c-0c5b30877255_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117633088?view=catalogue)
2025-12-01 19:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e5a1590>
2025-12-01 19:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_034ce54f-db67-523a-be2a-d5bd40f6f22c/034ce54f-db67-523a-be2a-d5bd40f6f22c_image_3.jpg HTTP/1.1" 201 0
2025-12-01 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBP21VJZ%252F2025-12-01%252Fimage%252F80abf68f-e1bc-4789-9137-4f20d11ef084_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/80abf68f-e1bc-4789-9137-4f20d11ef084_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 034ce54f-db67-523a-be2a-d5bd40f6f22c
2025-12-01 19:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e975e10>
2025-12-01 19:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-01 19:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_034ce54f-db67-523a-be2a-d5bd40f6f22c/034ce54f-db67-523a-be2a-d5bd40f6f22c_image_4.jpg HTTP/1.1" 201 0
2025-12-01 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBP21VJZ%252F2025-12-01%252Fimage%252Fb96c9726-60c0-4a1c-bc0c-0c5b30877255_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/b96c9726-60c0-4a1c-bc0c-0c5b30877255_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 034ce54f-db67-523a-be2a-d5bd40f6f22c
2025-12-01 19:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/b30108c0-5021-4ace-b3c0-ac4c49294250_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117633088?view=catalogue)
2025-12-01 19:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117553638?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-01 19:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-01 19:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-01 19:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-01 19:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f505e5c7e90>
2025-12-01 19:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-01 19:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-01 19:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-01 19:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-01 19:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-01 19:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-01 19:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_034ce54f-db67-523a-be2a-d5bd40f6f22c/034ce54f-db67-523a-be2a-d5bd40f6f22c_image_5.jpg HTTP/1.1" 201 0
2025-12-01 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBP21VJZ%252F2025-12-01%252Fimage%252Fb30108c0-5021-4ace-b3c0-ac4c49294250_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-01 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/b30108c0-5021-4ace-b3c0-ac4c49294250_removebg.jpg?w=600 saved to cache
2025-12-01 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 034ce54f-db67-523a-be2a-d5bd40f6f22c
2025-12-01 19:03:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 034ce54f-db67-523a-be2a-d5bd40f6f22c, skipping ID generation
2025-12-01 19:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 034ce54f-db67-523a-be2a-d5bd40f6f22c with scrape type 1
2025-12-01 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 034ce54f-db67-523a-be2a-d5bd40f6f22c from tracking dictionaries
2025-12-01 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 034ce54f-db67-523a-be2a-d5bd40f6f22c sending to next pipeline
2025-12-01 19:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 034ce54f-db67-523a-be2a-d5bd40f6f22c, identifier: 117633088
2025-12-01 19:03:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 034ce54f-db67-523a-be2a-d5bd40f6f22c with identifier: 117633088
2025-12-01 19:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 034ce54f-db67-523a-be2a-d5bd40f6f22c with identifier: 117633088
2025-12-01 19:03:47 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 034ce54f-db67-523a-be2a-d5bd40f6f22c with identifier: 117633088 to the API
2025-12-01 19:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-01 19:03:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/b30108c0-5021-4ace-b3c0-ac4c49294250_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '034ce54f-db67-523a-be2a-d5bd40f6f22c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BP21VJZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117633088',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'NISSAN',
 'model': 'MICRA HATCHBACK',
 'odometer': 42018,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_034ce54f-db67-523a-be2a-d5bd40f6f22c/034ce54f-db67-523a-be2a-d5bd40f6f22c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26300,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/5dd995d3-b1f3-4832-9f07-de0fc1c98448_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_034ce54f-db67-523a-be2a-d5bd40f6f22c/034ce54f-db67-523a-be2a-d5bd40f6f22c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27042,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/54c4e76f-e1e0-47a7-a823-1d3afe54029b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_034ce54f-db67-523a-be2a-d5bd40f6f22c/034ce54f-db67-523a-be2a-d5bd40f6f22c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30074,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/9f50c84c-6b86-4d9f-80f1-79288ee29428_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_034ce54f-db67-523a-be2a-d5bd40f6f22c/034ce54f-db67-523a-be2a-d5bd40f6f22c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28300,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/80abf68f-e1bc-4789-9137-4f20d11ef084_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_034ce54f-db67-523a-be2a-d5bd40f6f22c/034ce54f-db67-523a-be2a-d5bd40f6f22c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52452,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/b96c9726-60c0-4a1c-bc0c-0c5b30877255_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_034ce54f-db67-523a-be2a-d5bd40f6f22c/034ce54f-db67-523a-be2a-d5bd40f6f22c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71611,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/b30108c0-5021-4ace-b3c0-ac4c49294250_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-31',
 'seller_name': 'Local Dealer Group',
 'title': 'NISSAN MICRA HATCHBACK 1.0 IG-T 92 Acenta 5dr CVT',
 'transmission': 'automatic',
 'trim': '1.0 IG-T 92 Acenta 5dr CVT',
 'vin': None,
 'year': 2021}
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117633088%27 HTTP/1.1" 200 None
2025-12-01 19:03:48 [astonbarclay.gb] INFO: Saving data for 117633088: {'created_time': 1764615828.23533, 'last_price_update_time': 1764615828.23534, 'auction_closing_time': 1764755100.0}
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117633088') HTTP/1.1" 204 0
2025-12-01 19:03:48 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117553638, 'registration': 'NA65UCW', 'account': 'THE109', 'make': 'VOLKSWAGEN', 'model': 'POLO HATCHBACK', 'derivative': '1.2 TSI SE 5dr', 'mileage': 121410, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2015-12-04', 'fuel': 'Petrol', 'motExpiry': '2025-12-13', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:48 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117553638, 'registration': 'NA65UCW', 'account': 'THE109', 'make': 'VOLKSWAGEN', 'model': 'POLO HATCHBACK', 'derivative': '1.2 TSI SE 5dr', 'mileage': 121410, 'mileageWarranty': True, 'type': 'car', 'saleId': 17968, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 188}, 'saleStart': '2025-12-03T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2015-12-04', 'fuel': 'Petrol', 'motExpiry': '2025-12-13', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-01 19:03:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f557479-183d-572c-baa7-b4d678041bcb with identifier: 117553638
2025-12-01 19:03:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f557479-183d-572c-baa7-b4d678041bcb with scrape type 1
2025-12-01 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 4f557479-183d-572c-baa7-b4d678041bcb
2025-12-01 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 4f557479-183d-572c-baa7-b4d678041bcb
2025-12-01 19:03:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4f557479-183d-572c-baa7-b4d678041bcb, identifier: 117553638
2025-12-01 19:03:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4f557479-183d-572c-baa7-b4d678041bcb with identifier: 117553638
2025-12-01 19:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4f557479-183d-572c-baa7-b4d678041bcb with identifier: 117553638
2025-12-01 19:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 195389 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    195389
2025-12-01 19:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 4f557479-183d-572c-baa7-b4d678041bcb spider: astonbarclay.gb
2025-12-01 19:03:48 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 4f557479-183d-572c-baa7-b4d678041bcb due to rule: high_mileage_for_country.json, error: 195389 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    195389
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '4f557479-183d-572c-baa7-b4d678041bcb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NA65UCW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117553638',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'VOLKSWAGEN',
 'model': 'POLO HATCHBACK',
 'odometer': 121410,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-04',
 'seller_name': 'TCB Group - Prime',
 'title': 'VOLKSWAGEN POLO HATCHBACK 1.2 TSI SE 5dr',
 'transmission': 'manual',
 'trim': '1.2 TSI SE 5dr',
 'vin': None,
 'year': 2015}
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117553638%27 HTTP/1.1" 200 None
2025-12-01 19:03:48 [astonbarclay.gb] INFO: Saving data for 117553638: {'created_time': 1764615828.546543, 'last_price_update_time': 1764615828.546555, 'auction_closing_time': 1764755100.0}
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117553638') HTTP/1.1" 204 0
2025-12-01 19:03:48 [scrapy.core.engine] INFO: Closing spider (finished)
2025-12-01 19:03:48 [astonbarclay.gb] INFO: astonbarclay.gb Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117632412%27 HTTP/1.1" 200 None
2025-12-01 19:03:48 [astonbarclay.gb] INFO: Saving data for 117632412: {'created_time': 1764615828.660496}
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117632412') HTTP/1.1" 204 0
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20last_price_update_time%20lt%201764183828 HTTP/1.1" 200 None
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116098475') HTTP/1.1" 204 0
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116178889') HTTP/1.1" 204 0
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116196620') HTTP/1.1" 204 0
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116295138') HTTP/1.1" 204 0
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116325691') HTTP/1.1" 204 0
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116449331') HTTP/1.1" 204 0
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116552173') HTTP/1.1" 204 0
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116667539') HTTP/1.1" 204 0
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116876236') HTTP/1.1" 204 0
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116883547') HTTP/1.1" 204 0
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116963876') HTTP/1.1" 204 0
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116963900') HTTP/1.1" 204 0
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116963923') HTTP/1.1" 204 0
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116963954') HTTP/1.1" 204 0
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116963975') HTTP/1.1" 204 0
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116963987') HTTP/1.1" 204 0
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116964092') HTTP/1.1" 204 0
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116964128') HTTP/1.1" 204 0
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116964146') HTTP/1.1" 204 0
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116964172') HTTP/1.1" 204 0
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116987939') HTTP/1.1" 204 0
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116987948') HTTP/1.1" 204 0
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117030556') HTTP/1.1" 204 0
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117054932') HTTP/1.1" 204 0
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117059866') HTTP/1.1" 204 0
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117076151') HTTP/1.1" 204 0
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117076166') HTTP/1.1" 204 0
2025-12-01 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117076326') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117076340') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117081974') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117122306') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117123177') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117137526') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117137543') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117137574') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117137674') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117137747') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117145877') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117172901') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117181858') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117184113') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117188935') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117195495') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117195661') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117195735') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117195819') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117195833') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117195848') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117195887') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117195932') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117196062') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117210370') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117230741') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117237477') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117261007') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117288338') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117301347') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117311715') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117320392') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117333141') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117334851') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117335606') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117340295') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117346866') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117368861') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117390276') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117399229') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117415451') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117446584') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117452714') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117454424') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117459998') HTTP/1.1" 204 0
2025-12-01 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117492532') HTTP/1.1" 204 0
2025-12-01 19:03:49 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (84 items) in: file:///var/lib/scrapyd/items/sourcing_v2/astonbarclay.gb/task_36_2025-12-01T19_00_00.jl
2025-12-01 19:03:49 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 339044,
 'downloader/request_count': 590,
 'downloader/request_method_count/GET': 590,
 'downloader/response_bytes': 22600240,
 'downloader/response_count': 590,
 'downloader/response_status_count/200': 590,
 'elapsed_time_seconds': 223.385319,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2025, 12, 1, 19, 3, 49, 357088, tzinfo=datetime.timezone.utc),
 'item_dropped_count': 26,
 'item_dropped_reasons_count/DropItem': 26,
 'item_scraped_count': 84,
 'log_count/DEBUG': 7942,
 'log_count/ERROR': 37,
 'log_count/INFO': 7522,
 'memusage/max': 181321728,
 'memusage/startup': 127623168,
 'photo_download_count': 477,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 79,
 'playwright/request_count/aborted': 43,
 'playwright/request_count/method/GET': 56,
 'playwright/request_count/method/HEAD': 12,
 'playwright/request_count/method/POST': 11,
 'playwright/request_count/navigation': 2,
 'playwright/request_count/resource_type/document': 2,
 'playwright/request_count/resource_type/fetch': 22,
 'playwright/request_count/resource_type/font': 2,
 'playwright/request_count/resource_type/image': 31,
 'playwright/request_count/resource_type/script': 7,
 'playwright/request_count/resource_type/stylesheet': 2,
 'playwright/request_count/resource_type/xhr': 13,
 'playwright/response_count': 36,
 'playwright/response_count/method/GET': 25,
 'playwright/response_count/method/POST': 11,
 'playwright/response_count/resource_type/document': 2,
 'playwright/response_count/resource_type/fetch': 10,
 'playwright/response_count/resource_type/font': 2,
 'playwright/response_count/resource_type/script': 7,
 'playwright/response_count/resource_type/stylesheet': 2,
 'playwright/response_count/resource_type/xhr': 13,
 'request_depth_max': 3,
 'response_received_count': 113,
 'scheduler/dequeued': 590,
 'scheduler/dequeued/memory': 590,
 'scheduler/enqueued': 590,
 'scheduler/enqueued/memory': 590,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 112,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 8.086895038778104,
 'scrapy-zyte-api/mean_response_seconds': 8.090528619940287,
 'scrapy-zyte-api/processed': 112,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 112,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 111,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 112,
 'scrapy-zyte-api/request_args/httpResponseBody': 112,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 112,
 'scrapy-zyte-api/request_args/url': 112,
 'scrapy-zyte-api/status_codes/200': 112,
 'scrapy-zyte-api/success': 112,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2025, 12, 1, 19, 0, 5, 971769, tzinfo=datetime.timezone.utc)}
2025-12-01 19:03:49 [scrapy.core.engine] INFO: Spider closed (finished)