2025-12-04 20:00:10 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2025-12-04 20:00:10 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2025-12-04 20:00:10 [manheim.gb] INFO: Starting spider manheim.gb
2025-12-04 20:00:10 [scrapy.addons] INFO: Enabled addons:
[]
2025-12-04 20:00:10 [asyncio] DEBUG: Using selector: EpollSelector
2025-12-04 20:00:10 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2025-12-04 20:00:10 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2025-12-04 20:00:10 [scrapy.extensions.telnet] INFO: Telnet Password: db0f9d843a0948fc
2025-12-04 20:00:10 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2025-12-04 20:00:10 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/manheim.gb/task_37_2025-12-04T20_00_01.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2025-12-04 20:00:10 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-04 20:00:10 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-04 20:00:10 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2025-12-04 20:00:10 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2025-12-04 20:00:10 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2025-12-04 20:00:10 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2025-12-04 20:00:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:00:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:00:10 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2025-12-04 20:00:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2025-12-04 20:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:10 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2025-12-04 20:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2025-12-04 20:00:10 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2025-12-04 20:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2025-12-04 20:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2025-12-04 20:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2025-12-04 20:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2025-12-04 20:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2025-12-04 20:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2025-12-04 20:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2025-12-04 20:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2025-12-04 20:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2025-12-04 20:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2025-12-04 20:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2025-12-04 20:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2025-12-04 20:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2025-12-04 20:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2025-12-04 20:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2025-12-04 20:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2025-12-04 20:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2025-12-04 20:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2025-12-04 20:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2025-12-04 20:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2025-12-04 20:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2025-12-04 20:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2025-12-04 20:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2025-12-04 20:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2025-12-04 20:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2025-12-04 20:00:10 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2025-12-04 20:00:10 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2025-12-04 20:00:10 [scrapy.core.engine] INFO: Spider opened
2025-12-04 20:00:10 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-12-04 20:00:11 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2025-12-04 20:00:11 [scrapy-playwright] INFO: Starting download handler
2025-12-04 20:00:11 [scrapy-playwright] INFO: Starting download handler
2025-12-04 20:00:15 [scrapy-playwright] INFO: Launching browser firefox
2025-12-04 20:00:16 [scrapy-playwright] INFO: Browser firefox launched
2025-12-04 20:00:16 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2025-12-04 20:00:16 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2025-12-04 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/> (resource type: document)
2025-12-04 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://www.manheim.co.uk/>
2025-12-04 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/> (resource type: document)
2025-12-04 20:00:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/>
2025-12-04 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1> (resource type: stylesheet, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/bundles/delete/scripts/homepage?v=CIpuZXIp0V7i0j1sjTB9sUemSg9-D9w8k891UP0sReI1> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en>
2025-12-04 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en>
2025-12-04 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960>
2025-12-04 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960>
2025-12-04 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960>
2025-12-04 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-04 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1>
2025-12-04 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-04 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/core-blessed1.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-04 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/bundles/delete/scripts/homepage?v=CIpuZXIp0V7i0j1sjTB9sUemSg9-D9w8k891UP0sReI1>
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js>
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js>
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css>
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/core-blessed1.min.css>
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en>
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en>
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960>
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960>
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960>
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/filters/dot_pattern.png> (resource type: image, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/filters/dot_pattern.png>
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png> (resource type: image, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png>
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H>
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.manheim.co.uk/Account/IsCookieExist> (resource type: xhr, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/upload/christmasgiveawayhomepage.ashx?la=en&mw=1920> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/upload/christmasgiveawayhomepage.ashx?la=en&mw=1920>
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-8665-treated--hero.ashx?la=en&mw=1920> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-8665-treated--hero.ashx?la=en&mw=1920>
2025-12-04 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff>
2025-12-04 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff>
2025-12-04 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff>
2025-12-04 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff>
2025-12-04 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Account/IsCookieExist>
2025-12-04 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/pd.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-04 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-04 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/pd.js>
2025-12-04 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/analytics?ver=3&visitor_id=&visitor_id_sign=&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:26 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/analytics?ver=3&visitor_id=&visitor_id_sign=&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=>
2025-12-04 20:00:26 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=919056771&visitor_id_sign=a8c5e808f0c1cccf559779bfffcc010706c9f2d221d90f265578d8c90e728690b9677d664d75413fea1f2399a91d6794d5e025bd&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:27 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=919056771&visitor_id_sign=a8c5e808f0c1cccf559779bfffcc010706c9f2d221d90f265578d8c90e728690b9677d664d75413fea1f2399a91d6794d5e025bd&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=>
2025-12-04 20:00:33 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.manheim.co.uk/account/login> (resource type: document, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:33 [scrapy-playwright] DEBUG: [Context=default] Response: <302 https://www.manheim.co.uk/account/login> (location: /mymanheim/dashboard)
2025-12-04 20:00:33 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/mymanheim/dashboard> (resource type: document, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/mymanheim/dashboard>
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1> (resource type: stylesheet, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/bundles/delete/scripts/postlogin?v=Bwe963dGqUB3Sdny8E3tKSL2gV9GDgLwX1g6Gq6KF-A1> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/SignalR/Hubs> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en>
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/jquery-ui-1.12.1.js> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Content/myManheim.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/bundles/simulcast?v=P7s0oLmuXc3p3WQNs8URnZ4NaK3K6qkWLOwf0uOs5gw1> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Content/dashboards.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en>
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1>
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1>
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en>
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en>
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en>
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en>
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en>
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en>
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1>
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/core-blessed1.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-04 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/bundles/delete/scripts/postlogin?v=Bwe963dGqUB3Sdny8E3tKSL2gV9GDgLwX1g6Gq6KF-A1>
2025-12-04 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/SignalR/Hubs>
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <302 https://www.manheim.co.uk/Scripts/jquery-ui-1.12.1.js> (location: https://www.manheim.co.uk/404)
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/404> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Content/myManheim.css>
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/bundles/simulcast?v=P7s0oLmuXc3p3WQNs8URnZ4NaK3K6qkWLOwf0uOs5gw1>
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Content/dashboards.css>
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js>
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js>
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css>
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/core-blessed1.min.css>
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <404 https://www.manheim.co.uk/404>
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en>
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en>
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1>
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1>
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en>
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en>
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en>
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en>
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en>
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en>
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png> (resource type: image, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png>
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H>
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/thickbox/loadingAnimation.gif> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/thickbox/loadingAnimation.gif>
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.manheim.co.uk/Account/IsCookieExist> (resource type: xhr, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff>
2025-12-04 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff>
2025-12-04 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff>
2025-12-04 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff>
2025-12-04 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Account/IsCookieExist>
2025-12-04 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-04 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/pd.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-04 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/pd.js>
2025-12-04 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/analytics?ver=3&visitor_id=919056771&visitor_id_sign=a8c5e808f0c1cccf559779bfffcc010706c9f2d221d90f265578d8c90e728690b9677d664d75413fea1f2399a91d6794d5e025bd&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/analytics?ver=3&visitor_id=919056771&visitor_id_sign=a8c5e808f0c1cccf559779bfffcc010706c9f2d221d90f265578d8c90e728690b9677d664d75413fea1f2399a91d6794d5e025bd&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F>
2025-12-04 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=919056771&visitor_id_sign=a8c5e808f0c1cccf559779bfffcc010706c9f2d221d90f265578d8c90e728690b9677d664d75413fea1f2399a91d6794d5e025bd&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=919056771&visitor_id_sign=a8c5e808f0c1cccf559779bfffcc010706c9f2d221d90f265578d8c90e728690b9677d664d75413fea1f2399a91d6794d5e025bd&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F>
2025-12-04 20:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk> (referer: None) ['playwright']
2025-12-04 20:00:45 [manheim.gb] INFO: Cookies from Playwright: [{'name': 'ASP.NET_SessionId', 'value': 'obchgov20lrjfpbd0bda4mx0', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': -1, 'httpOnly': True, 'secure': True, 'sameSite': 'Lax'}, {'name': '__RequestVerificationToken', 'value': '-RqxvNmfT3BDebnVHfePSOpwWIoloiYRTvd6hY865do_2UbNQ-1RPVtR7bd1p1cSyGJAZt7O5Zh_XQeXe9Kzlrg7N8I1', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': -1, 'httpOnly': True, 'secure': True, 'sameSite': 'None'}, {'name': 'cb-enabled', 'value': 'enabled', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1796414422, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'remarketing-web', 'value': 'FDF5ECBE1B6B6CF48F2F35E902F5F9A6E0D0116917E61C4475C4DA4B91097DDEC085D8B74C7ADE775F5143F89F485E7E9444E38515AD55CBF125B4D90EAF9E04C0B7B0E14E0684A6CE22BE6DA5BCA3A326D4FB667331D63C05448274B46FE9D609588DD914496AA6F648C5B49484A4F97EEA1FB3', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': -1, 'httpOnly': True, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '919056771', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1796414440, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': 'a8c5e808f0c1cccf559779bfffcc010706c9f2d221d90f265578d8c90e728690b9677d664d75413fea1f2399a91d6794d5e025bd', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1796414440, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '919056771', 'domain': 'brands.coxauto.co.uk', 'path': '/', 'expires': 1796414441, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': 'a8c5e808f0c1cccf559779bfffcc010706c9f2d221d90f265578d8c90e728690b9677d664d75413fea1f2399a91d6794d5e025bd', 'domain': 'brands.coxauto.co.uk', 'path': '/', 'expires': 1796414441, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '919056771', 'domain': '.pardot.com', 'path': '/', 'expires': 1796414440, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': 'a8c5e808f0c1cccf559779bfffcc010706c9f2d221d90f265578d8c90e728690b9677d664d75413fea1f2399a91d6794d5e025bd', 'domain': '.pardot.com', 'path': '/', 'expires': 1796414440, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'lpv37592', 'value': 'aHR0cHM6Ly93d3cubWFuaGVpbS5jby51ay9teW1hbmhlaW0vZGFzaGJvYXJk', 'domain': 'pi.pardot.com', 'path': '/', 'expires': 1764880240, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2025-12-04 20:00:45 [manheim.gb] INFO: Scrapy-formatted cookies: [{'name': 'ASP.NET_SessionId', 'value': 'obchgov20lrjfpbd0bda4mx0', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': '__RequestVerificationToken', 'value': '-RqxvNmfT3BDebnVHfePSOpwWIoloiYRTvd6hY865do_2UbNQ-1RPVtR7bd1p1cSyGJAZt7O5Zh_XQeXe9Kzlrg7N8I1', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'cb-enabled', 'value': 'enabled', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'remarketing-web', 'value': 'FDF5ECBE1B6B6CF48F2F35E902F5F9A6E0D0116917E61C4475C4DA4B91097DDEC085D8B74C7ADE775F5143F89F485E7E9444E38515AD55CBF125B4D90EAF9E04C0B7B0E14E0684A6CE22BE6DA5BCA3A326D4FB667331D63C05448274B46FE9D609588DD914496AA6F648C5B49484A4F97EEA1FB3', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '919056771', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': 'a8c5e808f0c1cccf559779bfffcc010706c9f2d221d90f265578d8c90e728690b9677d664d75413fea1f2399a91d6794d5e025bd', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '919056771', 'domain': 'brands.coxauto.co.uk', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': 'a8c5e808f0c1cccf559779bfffcc010706c9f2d221d90f265578d8c90e728690b9677d664d75413fea1f2399a91d6794d5e025bd', 'domain': 'brands.coxauto.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '919056771', 'domain': '.pardot.com', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': 'a8c5e808f0c1cccf559779bfffcc010706c9f2d221d90f265578d8c90e728690b9677d664d75413fea1f2399a91d6794d5e025bd', 'domain': '.pardot.com', 'path': '/'}, {'name': 'lpv37592', 'value': 'aHR0cHM6Ly93d3cubWFuaGVpbS5jby51ay9teW1hbmhlaW0vZGFzaGJvYXJk', 'domain': 'pi.pardot.com', 'path': '/'}]
2025-12-04 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Manheim',RowKey='cookies') HTTP/1.1" 204 0
2025-12-04 20:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 20:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search) ['zyte-api']
2025-12-04 20:00:47 [manheim.gb] INFO: Found listing with ID: 1005857
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271005857%27 HTTP/1.1" 200 None
2025-12-04 20:00:47 [manheim.gb] INFO: Scrape type for 1005857: 0
2025-12-04 20:00:47 [manheim.gb] INFO: Found listing with ID: 1095462
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271095462%27 HTTP/1.1" 200 None
2025-12-04 20:00:47 [manheim.gb] INFO: Scrape type for 1095462: 1
2025-12-04 20:00:47 [manheim.gb] INFO: Found listing with ID: 1127441
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271127441%27 HTTP/1.1" 200 None
2025-12-04 20:00:47 [manheim.gb] INFO: Scrape type for 1127441: 0
2025-12-04 20:00:47 [manheim.gb] INFO: Found listing with ID: 1249898
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271249898%27 HTTP/1.1" 200 None
2025-12-04 20:00:47 [manheim.gb] INFO: Scrape type for 1249898: 1
2025-12-04 20:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 20:00:47 [manheim.gb] INFO: Found listing with ID: 1257174
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271257174%27 HTTP/1.1" 200 None
2025-12-04 20:00:47 [manheim.gb] INFO: Scrape type for 1257174: 2
2025-12-04 20:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 20:00:47 [manheim.gb] INFO: Found listing with ID: 1271730
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271271730%27 HTTP/1.1" 200 None
2025-12-04 20:00:47 [manheim.gb] INFO: Scrape type for 1271730: 0
2025-12-04 20:00:47 [manheim.gb] INFO: Found listing with ID: 1297328
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271297328%27 HTTP/1.1" 200 None
2025-12-04 20:00:47 [manheim.gb] INFO: Scrape type for 1297328: 2
2025-12-04 20:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 20:00:47 [manheim.gb] INFO: Found listing with ID: 1318037
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271318037%27 HTTP/1.1" 200 None
2025-12-04 20:00:47 [manheim.gb] INFO: Scrape type for 1318037: 1
2025-12-04 20:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 20:00:47 [manheim.gb] INFO: Found listing with ID: 1319653
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271319653%27 HTTP/1.1" 200 None
2025-12-04 20:00:47 [manheim.gb] INFO: Scrape type for 1319653: 0
2025-12-04 20:00:47 [manheim.gb] INFO: Found listing with ID: 1342103
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271342103%27 HTTP/1.1" 200 None
2025-12-04 20:00:47 [manheim.gb] INFO: Scrape type for 1342103: 1
2025-12-04 20:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 20:00:47 [manheim.gb] INFO: Found listing with ID: 1376686
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271376686%27 HTTP/1.1" 200 None
2025-12-04 20:00:47 [manheim.gb] INFO: Scrape type for 1376686: 0
2025-12-04 20:00:47 [manheim.gb] INFO: Found listing with ID: 1403363
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271403363%27 HTTP/1.1" 200 None
2025-12-04 20:00:47 [manheim.gb] INFO: Scrape type for 1403363: 0
2025-12-04 20:00:47 [manheim.gb] INFO: Found listing with ID: 1410764
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271410764%27 HTTP/1.1" 200 None
2025-12-04 20:00:47 [manheim.gb] INFO: Scrape type for 1410764: 1
2025-12-04 20:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 20:00:47 [manheim.gb] INFO: Found listing with ID: 1430865
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271430865%27 HTTP/1.1" 200 None
2025-12-04 20:00:47 [manheim.gb] INFO: Scrape type for 1430865: 0
2025-12-04 20:00:47 [manheim.gb] INFO: Found listing with ID: 1479833
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271479833%27 HTTP/1.1" 200 None
2025-12-04 20:00:47 [manheim.gb] INFO: Scrape type for 1479833: 0
2025-12-04 20:00:47 [manheim.gb] INFO: Found listing with ID: 1484153
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271484153%27 HTTP/1.1" 200 None
2025-12-04 20:00:47 [manheim.gb] INFO: Scrape type for 1484153: 0
2025-12-04 20:00:47 [manheim.gb] INFO: Found listing with ID: 1535266
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271535266%27 HTTP/1.1" 200 None
2025-12-04 20:00:47 [manheim.gb] INFO: Scrape type for 1535266: 0
2025-12-04 20:00:47 [manheim.gb] INFO: Found listing with ID: 1563459
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271563459%27 HTTP/1.1" 200 None
2025-12-04 20:00:48 [manheim.gb] INFO: Scrape type for 1563459: 0
2025-12-04 20:00:48 [manheim.gb] INFO: Found listing with ID: 1564179
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271564179%27 HTTP/1.1" 200 None
2025-12-04 20:00:48 [manheim.gb] INFO: Scrape type for 1564179: 0
2025-12-04 20:00:48 [manheim.gb] INFO: Found listing with ID: 1603150
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271603150%27 HTTP/1.1" 200 None
2025-12-04 20:00:48 [manheim.gb] INFO: Scrape type for 1603150: 1
2025-12-04 20:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 20:00:48 [manheim.gb] INFO: Found listing with ID: 1611374
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271611374%27 HTTP/1.1" 200 None
2025-12-04 20:00:48 [manheim.gb] INFO: Scrape type for 1611374: 1
2025-12-04 20:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 20:00:48 [manheim.gb] INFO: Found listing with ID: 1678661
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271678661%27 HTTP/1.1" 200 None
2025-12-04 20:00:48 [manheim.gb] INFO: Scrape type for 1678661: 1
2025-12-04 20:00:48 [manheim.gb] INFO: Found listing with ID: 1708581
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271708581%27 HTTP/1.1" 200 None
2025-12-04 20:00:48 [manheim.gb] INFO: Scrape type for 1708581: 1
2025-12-04 20:00:48 [manheim.gb] INFO: Found listing with ID: 1714274
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271714274%27 HTTP/1.1" 200 None
2025-12-04 20:00:48 [manheim.gb] INFO: Scrape type for 1714274: 0
2025-12-04 20:00:48 [manheim.gb] INFO: Found listing with ID: 1727332
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271727332%27 HTTP/1.1" 200 None
2025-12-04 20:00:48 [manheim.gb] INFO: Scrape type for 1727332: 1
2025-12-04 20:00:48 [manheim.gb] INFO: Found listing with ID: 1749068
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271749068%27 HTTP/1.1" 200 None
2025-12-04 20:00:48 [manheim.gb] INFO: Scrape type for 1749068: 1
2025-12-04 20:00:48 [manheim.gb] INFO: Found listing with ID: 1753030
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271753030%27 HTTP/1.1" 200 None
2025-12-04 20:00:48 [manheim.gb] INFO: Scrape type for 1753030: 0
2025-12-04 20:00:48 [manheim.gb] INFO: Found listing with ID: 1761741
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271761741%27 HTTP/1.1" 200 None
2025-12-04 20:00:48 [manheim.gb] INFO: Scrape type for 1761741: 0
2025-12-04 20:00:48 [manheim.gb] INFO: Found listing with ID: 1783769
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271783769%27 HTTP/1.1" 200 None
2025-12-04 20:00:48 [manheim.gb] INFO: Scrape type for 1783769: 0
2025-12-04 20:00:48 [manheim.gb] INFO: Found listing with ID: 1877473
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271877473%27 HTTP/1.1" 200 None
2025-12-04 20:00:48 [manheim.gb] INFO: Scrape type for 1877473: 0
2025-12-04 20:00:48 [manheim.gb] INFO: Found listing with ID: 1962040
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271962040%27 HTTP/1.1" 200 None
2025-12-04 20:00:48 [manheim.gb] INFO: Scrape type for 1962040: 0
2025-12-04 20:00:48 [manheim.gb] INFO: Found listing with ID: 1966868
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271966868%27 HTTP/1.1" 200 None
2025-12-04 20:00:48 [manheim.gb] INFO: Scrape type for 1966868: 0
2025-12-04 20:00:48 [manheim.gb] INFO: Found listing with ID: 1976170
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271976170%27 HTTP/1.1" 200 None
2025-12-04 20:00:48 [manheim.gb] INFO: Scrape type for 1976170: 0
2025-12-04 20:00:48 [manheim.gb] INFO: Found listing with ID: 1995165
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271995165%27 HTTP/1.1" 200 None
2025-12-04 20:00:48 [manheim.gb] INFO: Scrape type for 1995165: 0
2025-12-04 20:00:48 [manheim.gb] INFO: Found listing with ID: 2022887
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272022887%27 HTTP/1.1" 200 None
2025-12-04 20:00:48 [manheim.gb] INFO: Scrape type for 2022887: 0
2025-12-04 20:00:48 [manheim.gb] INFO: Found listing with ID: 2029104
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272029104%27 HTTP/1.1" 200 None
2025-12-04 20:00:48 [manheim.gb] INFO: Scrape type for 2029104: 1
2025-12-04 20:00:48 [manheim.gb] INFO: Found listing with ID: 2057516
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272057516%27 HTTP/1.1" 200 None
2025-12-04 20:00:48 [manheim.gb] INFO: Scrape type for 2057516: 2
2025-12-04 20:00:48 [manheim.gb] INFO: Found listing with ID: 2058572
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272058572%27 HTTP/1.1" 200 None
2025-12-04 20:00:48 [manheim.gb] INFO: Scrape type for 2058572: 2
2025-12-04 20:00:48 [manheim.gb] INFO: Found listing with ID: 2063938
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272063938%27 HTTP/1.1" 200 None
2025-12-04 20:00:48 [manheim.gb] INFO: Scrape type for 2063938: 0
2025-12-04 20:00:48 [manheim.gb] INFO: Found listing with ID: 2075642
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272075642%27 HTTP/1.1" 200 None
2025-12-04 20:00:48 [manheim.gb] INFO: Scrape type for 2075642: 0
2025-12-04 20:00:48 [manheim.gb] INFO: Found listing with ID: 2107189
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272107189%27 HTTP/1.1" 200 None
2025-12-04 20:00:48 [manheim.gb] INFO: Scrape type for 2107189: 1
2025-12-04 20:00:48 [manheim.gb] INFO: Found listing with ID: 2171364
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272171364%27 HTTP/1.1" 200 None
2025-12-04 20:00:48 [manheim.gb] INFO: Scrape type for 2171364: 1
2025-12-04 20:00:48 [manheim.gb] INFO: Found listing with ID: 2176421
2025-12-04 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272176421%27 HTTP/1.1" 200 None
2025-12-04 20:00:49 [manheim.gb] INFO: Scrape type for 2176421: 0
2025-12-04 20:00:49 [manheim.gb] INFO: Found listing with ID: 2213009
2025-12-04 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272213009%27 HTTP/1.1" 200 None
2025-12-04 20:00:49 [manheim.gb] INFO: Scrape type for 2213009: 1
2025-12-04 20:00:49 [manheim.gb] INFO: Found listing with ID: 2213672
2025-12-04 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272213672%27 HTTP/1.1" 200 None
2025-12-04 20:00:49 [manheim.gb] INFO: Scrape type for 2213672: 0
2025-12-04 20:00:49 [manheim.gb] INFO: Found listing with ID: 2216514
2025-12-04 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272216514%27 HTTP/1.1" 200 None
2025-12-04 20:00:49 [manheim.gb] INFO: Scrape type for 2216514: 1
2025-12-04 20:00:49 [manheim.gb] INFO: Found listing with ID: 2237239
2025-12-04 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272237239%27 HTTP/1.1" 200 None
2025-12-04 20:00:49 [manheim.gb] INFO: Scrape type for 2237239: 0
2025-12-04 20:00:49 [manheim.gb] INFO: Found listing with ID: 2247450
2025-12-04 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272247450%27 HTTP/1.1" 200 None
2025-12-04 20:00:49 [manheim.gb] INFO: Scrape type for 2247450: 0
2025-12-04 20:00:49 [manheim.gb] INFO: Found listing with ID: 2262431
2025-12-04 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272262431%27 HTTP/1.1" 200 None
2025-12-04 20:00:49 [manheim.gb] INFO: Scrape type for 2262431: 0
2025-12-04 20:00:49 [manheim.gb] INFO: Found listing with ID: 2265358
2025-12-04 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272265358%27 HTTP/1.1" 200 None
2025-12-04 20:00:49 [manheim.gb] INFO: Scrape type for 2265358: 0
2025-12-04 20:00:49 [manheim.gb] INFO: Found listing with ID: 2274146
2025-12-04 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272274146%27 HTTP/1.1" 200 None
2025-12-04 20:00:49 [manheim.gb] INFO: Scrape type for 2274146: 2
2025-12-04 20:00:49 [manheim.gb] INFO: Found listing with ID: 2283791
2025-12-04 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272283791%27 HTTP/1.1" 200 None
2025-12-04 20:00:49 [manheim.gb] INFO: Scrape type for 2283791: 1
2025-12-04 20:00:49 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-04 20:00:49 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-04 20:00:49 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-04 20:00:49 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-04 20:00:49 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-04 20:00:49 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-04 20:00:49 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-04 20:00:49 [scrapy.core.scraper] ERROR: Spider error processing <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 295, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/_middlewares.py", line 206, in process_spider_output_async
    async for item_or_request in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-04 20:01:10 [scrapy.extensions.logstats] INFO: Crawled 2 pages (at 2 pages/min), scraped 0 items (at 0 items/min)
2025-12-04 20:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/HYUNDAI/IX35?id=1095462&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231095462&indx=4> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 20:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 20:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b50bf259-323e-5483-b08f-2e017eb9c2b9 with identifier: 1095462
2025-12-04 20:01:12 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b50bf259-323e-5483-b08f-2e017eb9c2b9
2025-12-04 20:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/C1?id=1297328&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231297328&indx=13> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 20:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 20:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f26da7e4-b5b3-56d4-a53a-3407e101d96f with identifier: 1297328
2025-12-04 20:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f26da7e4-b5b3-56d4-a53a-3407e101d96f with scrape type 2
2025-12-04 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f26da7e4-b5b3-56d4-a53a-3407e101d96f with scrape type 2
2025-12-04 20:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f26da7e4-b5b3-56d4-a53a-3407e101d96f, identifier: 1297328
2025-12-04 20:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f26da7e4-b5b3-56d4-a53a-3407e101d96f with identifier: 1297328
2025-12-04 20:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 20:01:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLUE HTTP/1.1" 200 None
2025-12-04 20:01:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 20:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 20:01:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol HTTP/1.1" 200 None
2025-12-04 20:01:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 20:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f26da7e4-b5b3-56d4-a53a-3407e101d96f with identifier: 1297328
2025-12-04 20:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-04 20:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: f26da7e4-b5b3-56d4-a53a-3407e101d96f spider: manheim.gb
2025-12-04 20:01:16 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: f26da7e4-b5b3-56d4-a53a-3407e101d96f due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001297328-01988935-002.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'f26da7e4-b5b3-56d4-a53a-3407e101d96f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'PJ65MPU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C1?id=1297328',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'CITROEN',
 'model': 'C1',
 'odometer': 58554,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-27',
 'seller_name': 'Available Car',
 'title': 'CITROEN C1 1.0 VTi Feel 3dr',
 'transmission': 'manual',
 'trim': '1.0 VTi Feel 3dr',
 'year': 2015}
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271297328%27 HTTP/1.1" 200 None
2025-12-04 20:01:16 [manheim.gb] INFO: Saving data for 1297328: {'auction_closing_time': 1765184400.0, 'created_time': 1764756097.956274, 'last_price_update_time': 1764878476.177378}
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1297328') HTTP/1.1" 204 0
2025-12-04 20:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001095462-01985949-001.pdf> (referer: None)
2025-12-04 20:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91b93f50>
2025-12-04 20:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_expert_report_file_960fb0da-a106-4e5f-a7d4-6400cde2378e.pdf HTTP/1.1" 201 0
2025-12-04 20:01:16 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b50bf259-323e-5483-b08f-2e017eb9c2b9
2025-12-04 20:01:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b50bf259-323e-5483-b08f-2e017eb9c2b9, skipping ID generation
2025-12-04 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item b50bf259-323e-5483-b08f-2e017eb9c2b9
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_7.jpg not downloaded yet
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_7.jpg not downloaded yet
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_6.jpg not downloaded yet
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_1.jpg not downloaded yet
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ada0acf-0f16-4947-900c-8b3342e54fb8_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_5.jpg not downloaded yet
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ada0acf-0f16-4947-900c-8b3342e54fb8_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_4.jpg not downloaded yet
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ada0acf-0f16-4947-900c-8b3342e54fb8_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_11.jpg not downloaded yet
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ada0acf-0f16-4947-900c-8b3342e54fb8_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_10.jpg not downloaded yet
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ada0acf-0f16-4947-900c-8b3342e54fb8_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_9.jpg not downloaded yet
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_2.jpg not downloaded yet
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_5.jpg not downloaded yet
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_3.jpg not downloaded yet
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_4.jpg not downloaded yet
2025-12-04 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1095462-4008069-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1095462-4008069-13.jpg not downloaded yet
2025-12-04 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1095462-4008069-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1095462-4008069-1000.jpg not downloaded yet
2025-12-04 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1095462-4008069-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1095462-4008069-1001.jpg not downloaded yet
2025-12-04 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1095462-4008069-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1095462-4008069-1002.jpg not downloaded yet
2025-12-04 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1095462-4008069-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1095462-4008069-1003.jpg not downloaded yet
2025-12-04 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1095462-4008069-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1095462-4008069-1004.jpg not downloaded yet
2025-12-04 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1095462-4008069-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1095462-4008069-1005.jpg not downloaded yet
2025-12-04 20:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/208?id=1603150&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231603150&indx=35> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 20:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 20:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36d1985b-0da7-5cd6-a108-89002b3a47da with identifier: 1603150
2025-12-04 20:01:18 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 36d1985b-0da7-5cd6-a108-89002b3a47da
2025-12-04 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=1342103&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231342103&indx=17> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 20:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 20:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7eb992b2-0225-549c-ba34-fa3e969cb29a with identifier: 1342103
2025-12-04 20:01:18 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 7eb992b2-0225-549c-ba34-fa3e969cb29a
2025-12-04 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1095462-4008069-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001095462-01985949-001.pdf)
2025-12-04 20:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a3f610>
2025-12-04 20:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_19.jpg HTTP/1.1" 201 0
2025-12-04 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1095462-4008069-1005.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1095462-4008069-1005.jpg saved to cache
2025-12-04 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item b50bf259-323e-5483-b08f-2e017eb9c2b9
2025-12-04 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001603150-01991005-002.pdf> (referer: None)
2025-12-04 20:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a52e50>
2025-12-04 20:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_expert_report_file_4ea352b8-760d-4248-91ee-9d1ce7dd68da.pdf HTTP/1.1" 201 0
2025-12-04 20:01:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 36d1985b-0da7-5cd6-a108-89002b3a47da
2025-12-04 20:01:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36d1985b-0da7-5cd6-a108-89002b3a47da, skipping ID generation
2025-12-04 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 36d1985b-0da7-5cd6-a108-89002b3a47da
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_7.jpg not downloaded yet
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_7.jpg not downloaded yet
2025-12-04 20:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1095462-4008069-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001095462-01985949-001.pdf)
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_6.jpg not downloaded yet
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_1.jpg not downloaded yet
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e3033fa-0be7-4291-9cae-f72b6d2a22db_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_5.jpg not downloaded yet
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e3033fa-0be7-4291-9cae-f72b6d2a22db_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_4.jpg not downloaded yet
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e3033fa-0be7-4291-9cae-f72b6d2a22db_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_11.jpg not downloaded yet
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e3033fa-0be7-4291-9cae-f72b6d2a22db_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_10.jpg not downloaded yet
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e3033fa-0be7-4291-9cae-f72b6d2a22db_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_9.jpg not downloaded yet
2025-12-04 20:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91b9b610>
2025-12-04 20:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_18.jpg HTTP/1.1" 201 0
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1095462-4008069-1004.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1095462-4008069-1004.jpg saved to cache
2025-12-04 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item b50bf259-323e-5483-b08f-2e017eb9c2b9
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_2.jpg not downloaded yet
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_5.jpg not downloaded yet
2025-12-04 20:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001603150-01991005-002.pdf)
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_3.jpg not downloaded yet
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_4.jpg not downloaded yet
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1603150-4008522-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1603150-4008522-13.jpg not downloaded yet
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1603150-4008522-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1603150-4008522-1000.jpg not downloaded yet
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1603150-4008522-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1603150-4008522-1001.jpg not downloaded yet
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1603150-4008522-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1603150-4008522-1002.jpg not downloaded yet
2025-12-04 20:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a68a90>
2025-12-04 20:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_1.jpg HTTP/1.1" 201 0
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_7.jpg saved to cache
2025-12-04 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36d1985b-0da7-5cd6-a108-89002b3a47da
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1603150-4008522-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1603150-4008522-1003.jpg not downloaded yet
2025-12-04 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1603150-4008522-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1603150-4008522-1004.jpg not downloaded yet
2025-12-04 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1603150-4008522-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1603150-4008522-1005.jpg not downloaded yet
2025-12-04 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001603150-01991005-002.pdf)
2025-12-04 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001342103-01987715-002.pdf> (referer: None)
2025-12-04 20:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92159810>
2025-12-04 20:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_10.jpg HTTP/1.1" 201 0
2025-12-04 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_5.jpg saved to cache
2025-12-04 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 36d1985b-0da7-5cd6-a108-89002b3a47da
2025-12-04 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1603150-4008522-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001603150-01991005-002.pdf)
2025-12-04 20:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91adad50>
2025-12-04 20:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_expert_report_file_ddd7870e-0f8b-4696-a713-877c9fccad53.pdf HTTP/1.1" 201 0
2025-12-04 20:01:20 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 7eb992b2-0225-549c-ba34-fa3e969cb29a
2025-12-04 20:01:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7eb992b2-0225-549c-ba34-fa3e969cb29a, skipping ID generation
2025-12-04 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 7eb992b2-0225-549c-ba34-fa3e969cb29a
2025-12-04 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbd96da05-bb1a-438d-9b7d-57e422063ab3_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_7.jpg not downloaded yet
2025-12-04 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbd96da05-bb1a-438d-9b7d-57e422063ab3_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_7.jpg not downloaded yet
2025-12-04 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/C4PICASSO?id=1257174&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231257174&indx=11> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbd96da05-bb1a-438d-9b7d-57e422063ab3_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_6.jpg not downloaded yet
2025-12-04 20:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 20:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a725d0>
2025-12-04 20:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_18.jpg HTTP/1.1" 201 0
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1603150-4008522-1004.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1603150-4008522-1004.jpg saved to cache
2025-12-04 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 36d1985b-0da7-5cd6-a108-89002b3a47da
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbd96da05-bb1a-438d-9b7d-57e422063ab3_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_1.jpg not downloaded yet
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbd96da05-bb1a-438d-9b7d-57e422063ab3_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_5.jpg not downloaded yet
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbd96da05-bb1a-438d-9b7d-57e422063ab3_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_4.jpg not downloaded yet
2025-12-04 20:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdfa72ea-2e3a-5643-a0c1-88303f72987e with identifier: 1257174
2025-12-04 20:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdfa72ea-2e3a-5643-a0c1-88303f72987e with scrape type 2
2025-12-04 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdfa72ea-2e3a-5643-a0c1-88303f72987e with scrape type 2
2025-12-04 20:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: fdfa72ea-2e3a-5643-a0c1-88303f72987e, identifier: 1257174
2025-12-04 20:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: fdfa72ea-2e3a-5643-a0c1-88303f72987e with identifier: 1257174
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel HTTP/1.1" 200 None
2025-12-04 20:01:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 20:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: fdfa72ea-2e3a-5643-a0c1-88303f72987e with identifier: 1257174
2025-12-04 20:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 154446 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154446
2025-12-04 20:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: fdfa72ea-2e3a-5643-a0c1-88303f72987e spider: manheim.gb
2025-12-04 20:01:21 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: fdfa72ea-2e3a-5643-a0c1-88303f72987e due to rule: high_mileage_for_country.json, error: 154446 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154446
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001257174-01991822-003.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'fdfa72ea-2e3a-5643-a0c1-88303f72987e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LM65HBJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C4%20PICASSO?id=1257174',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'CITROEN',
 'model': 'C4 PICASSO',
 'odometer': 95969,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-31',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'CITROEN C4 PICASSO 1.6 BlueHDi 100 VTR+ 5dr',
 'transmission': 'manual',
 'trim': '1.6 BlueHDi 100 VTR+ 5dr',
 'year': 2015}
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271257174%27 HTTP/1.1" 200 None
2025-12-04 20:01:21 [manheim.gb] INFO: Saving data for 1257174: {'auction_closing_time': 1765184400.0, 'created_time': 1764756093.282903, 'last_price_update_time': 1764878481.827974}
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1257174') HTTP/1.1" 204 0
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbd96da05-bb1a-438d-9b7d-57e422063ab3_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_11.jpg not downloaded yet
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbd96da05-bb1a-438d-9b7d-57e422063ab3_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_10.jpg not downloaded yet
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbd96da05-bb1a-438d-9b7d-57e422063ab3_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_9.jpg not downloaded yet
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbd96da05-bb1a-438d-9b7d-57e422063ab3_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_2.jpg not downloaded yet
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbd96da05-bb1a-438d-9b7d-57e422063ab3_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_5.jpg not downloaded yet
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbd96da05-bb1a-438d-9b7d-57e422063ab3_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_3.jpg not downloaded yet
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbd96da05-bb1a-438d-9b7d-57e422063ab3_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_4.jpg not downloaded yet
2025-12-04 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1342103-4008795-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1342103-4008795-13.jpg not downloaded yet
2025-12-04 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1342103-4008795-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1342103-4008795-1000.jpg not downloaded yet
2025-12-04 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1342103-4008795-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1342103-4008795-1001.jpg not downloaded yet
2025-12-04 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1342103-4008795-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1342103-4008795-1002.jpg not downloaded yet
2025-12-04 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1342103-4008795-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1342103-4008795-1003.jpg not downloaded yet
2025-12-04 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1342103-4008795-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1342103-4008795-1004.jpg not downloaded yet
2025-12-04 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1342103-4008795-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1342103-4008795-1005.jpg not downloaded yet
2025-12-04 20:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/KIA/SPORTAGE?id=1318037&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231318037&indx=15> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 20:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 20:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1342103-4008795-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001342103-01987715-002.pdf)
2025-12-04 20:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9834b75b-9b16-585b-86ba-6806a78a5d4d with identifier: 1318037
2025-12-04 20:01:22 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9834b75b-9b16-585b-86ba-6806a78a5d4d
2025-12-04 20:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1342103-4008795-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001342103-01987715-002.pdf)
2025-12-04 20:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1342103-4008795-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001342103-01987715-002.pdf)
2025-12-04 20:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a6a110>
2025-12-04 20:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_19.jpg HTTP/1.1" 201 0
2025-12-04 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1342103-4008795-1005.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1342103-4008795-1005.jpg saved to cache
2025-12-04 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 7eb992b2-0225-549c-ba34-fa3e969cb29a
2025-12-04 20:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/ACLASS?id=1249898&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231249898&indx=10> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 20:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 20:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c920b1510>
2025-12-04 20:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_17.jpg HTTP/1.1" 201 0
2025-12-04 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1342103-4008795-1003.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1342103-4008795-1003.jpg saved to cache
2025-12-04 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 7eb992b2-0225-549c-ba34-fa3e969cb29a
2025-12-04 20:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92119610>
2025-12-04 20:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_18.jpg HTTP/1.1" 201 0
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1342103-4008795-1004.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1342103-4008795-1004.jpg saved to cache
2025-12-04 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 7eb992b2-0225-549c-ba34-fa3e969cb29a
2025-12-04 20:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1342103-4008795-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001342103-01987715-002.pdf)
2025-12-04 20:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1342103-4008795-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001342103-01987715-002.pdf)
2025-12-04 20:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1342103-4008795-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001342103-01987715-002.pdf)
2025-12-04 20:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f69bc873-1269-58a9-a911-771cacf24f5d with identifier: 1249898
2025-12-04 20:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f69bc873-1269-58a9-a911-771cacf24f5d with scrape type 1
2025-12-04 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item f69bc873-1269-58a9-a911-771cacf24f5d
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f30e2ea-5828-4377-bc71-79cf417402d7_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_7.jpg not downloaded yet
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f30e2ea-5828-4377-bc71-79cf417402d7_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_7.jpg not downloaded yet
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f30e2ea-5828-4377-bc71-79cf417402d7_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_6.jpg not downloaded yet
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f30e2ea-5828-4377-bc71-79cf417402d7_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_1.jpg not downloaded yet
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f30e2ea-5828-4377-bc71-79cf417402d7_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_5.jpg not downloaded yet
2025-12-04 20:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9224e1d0>
2025-12-04 20:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_15.jpg HTTP/1.1" 201 0
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1342103-4008795-1001.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1342103-4008795-1001.jpg saved to cache
2025-12-04 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 7eb992b2-0225-549c-ba34-fa3e969cb29a
2025-12-04 20:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c923de150>
2025-12-04 20:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_14.jpg HTTP/1.1" 201 0
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1342103-4008795-1000.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1342103-4008795-1000.jpg saved to cache
2025-12-04 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 7eb992b2-0225-549c-ba34-fa3e969cb29a
2025-12-04 20:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c923b2a90>
2025-12-04 20:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_16.jpg HTTP/1.1" 201 0
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1342103-4008795-1002.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1342103-4008795-1002.jpg saved to cache
2025-12-04 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 7eb992b2-0225-549c-ba34-fa3e969cb29a
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f30e2ea-5828-4377-bc71-79cf417402d7_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_4.jpg not downloaded yet
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f30e2ea-5828-4377-bc71-79cf417402d7_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_11.jpg not downloaded yet
2025-12-04 20:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/POLO?id=1410764&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231410764&indx=22> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 20:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001342103-01987715-002.pdf)
2025-12-04 20:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001342103-01987715-002.pdf)
2025-12-04 20:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001342103-01987715-002.pdf)
2025-12-04 20:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f30e2ea-5828-4377-bc71-79cf417402d7_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_10.jpg not downloaded yet
2025-12-04 20:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1342103-4008795-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001342103-01987715-002.pdf)
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f30e2ea-5828-4377-bc71-79cf417402d7_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_9.jpg not downloaded yet
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f30e2ea-5828-4377-bc71-79cf417402d7_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_2.jpg not downloaded yet
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f30e2ea-5828-4377-bc71-79cf417402d7_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_5.jpg not downloaded yet
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f30e2ea-5828-4377-bc71-79cf417402d7_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_3.jpg not downloaded yet
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f30e2ea-5828-4377-bc71-79cf417402d7_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_4.jpg not downloaded yet
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1249898-4008614-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1249898-4008614-13.jpg not downloaded yet
2025-12-04 20:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf with identifier: 1410764
2025-12-04 20:01:24 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf
2025-12-04 20:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9233b050>
2025-12-04 20:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_11.jpg HTTP/1.1" 201 0
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbd96da05-bb1a-438d-9b7d-57e422063ab3_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_3.jpg saved to cache
2025-12-04 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 7eb992b2-0225-549c-ba34-fa3e969cb29a
2025-12-04 20:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92059610>
2025-12-04 20:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_12.jpg HTTP/1.1" 201 0
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbd96da05-bb1a-438d-9b7d-57e422063ab3_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_4.jpg saved to cache
2025-12-04 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 7eb992b2-0225-549c-ba34-fa3e969cb29a
2025-12-04 20:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c921a8990>
2025-12-04 20:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_10.jpg HTTP/1.1" 201 0
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbd96da05-bb1a-438d-9b7d-57e422063ab3_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_5.jpg saved to cache
2025-12-04 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 7eb992b2-0225-549c-ba34-fa3e969cb29a
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1249898-4008614-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1249898-4008614-1000.jpg not downloaded yet
2025-12-04 20:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92358290>
2025-12-04 20:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_13.jpg HTTP/1.1" 201 0
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1342103-4008795-13.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1342103-4008795-13.jpg saved to cache
2025-12-04 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 7eb992b2-0225-549c-ba34-fa3e969cb29a
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1249898-4008614-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1249898-4008614-1001.jpg not downloaded yet
2025-12-04 20:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_11.jpg> (referer: None)
2025-12-04 20:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_6.jpg> (referer: None)
2025-12-04 20:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_5.jpg> (referer: None)
2025-12-04 20:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_4.jpg> (referer: None)
2025-12-04 20:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_1.jpg> (referer: None)
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1249898-4008614-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1249898-4008614-1002.jpg not downloaded yet
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1249898-4008614-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1249898-4008614-1003.jpg not downloaded yet
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1249898-4008614-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1249898-4008614-1004.jpg not downloaded yet
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1249898-4008614-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1249898-4008614-1005.jpg not downloaded yet
2025-12-04 20:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001318037-01991292-002.pdf> (referer: None)
2025-12-04 20:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a06810>
2025-12-04 20:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_6.jpg HTTP/1.1" 201 0
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f30e2ea-5828-4377-bc71-79cf417402d7_11.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_11.jpg saved to cache
2025-12-04 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f69bc873-1269-58a9-a911-771cacf24f5d
2025-12-04 20:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c921e9710>
2025-12-04 20:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_2.jpg HTTP/1.1" 201 0
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f30e2ea-5828-4377-bc71-79cf417402d7_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_6.jpg saved to cache
2025-12-04 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f69bc873-1269-58a9-a911-771cacf24f5d
2025-12-04 20:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1249898-4008614-1000.jpg> (referer: None)
2025-12-04 20:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_4.jpg> (referer: None)
2025-12-04 20:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92393610>
2025-12-04 20:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_4.jpg HTTP/1.1" 201 0
2025-12-04 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f30e2ea-5828-4377-bc71-79cf417402d7_5.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_5.jpg saved to cache
2025-12-04 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f69bc873-1269-58a9-a911-771cacf24f5d
2025-12-04 20:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9233a390>
2025-12-04 20:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_5.jpg HTTP/1.1" 201 0
2025-12-04 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f30e2ea-5828-4377-bc71-79cf417402d7_4.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_4.jpg saved to cache
2025-12-04 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f69bc873-1269-58a9-a911-771cacf24f5d
2025-12-04 20:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9217ce90>
2025-12-04 20:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_3.jpg HTTP/1.1" 201 0
2025-12-04 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f30e2ea-5828-4377-bc71-79cf417402d7_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_1.jpg saved to cache
2025-12-04 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f69bc873-1269-58a9-a911-771cacf24f5d
2025-12-04 20:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c920a7450>
2025-12-04 20:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_expert_report_file_991eecd3-5c73-451c-bb64-5ae6aea0f355.pdf HTTP/1.1" 201 0
2025-12-04 20:01:27 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9834b75b-9b16-585b-86ba-6806a78a5d4d
2025-12-04 20:01:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9834b75b-9b16-585b-86ba-6806a78a5d4d, skipping ID generation
2025-12-04 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 9834b75b-9b16-585b-86ba-6806a78a5d4d
2025-12-04 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa764fc79-a021-4dde-b2b5-7474b5669ca7_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_7.jpg not downloaded yet
2025-12-04 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1249898-4008614-13.jpg> (referer: None)
2025-12-04 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa764fc79-a021-4dde-b2b5-7474b5669ca7_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_7.jpg not downloaded yet
2025-12-04 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1249898-4008614-1001.jpg> (referer: None)
2025-12-04 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa764fc79-a021-4dde-b2b5-7474b5669ca7_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_6.jpg not downloaded yet
2025-12-04 20:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91ae3410>
2025-12-04 20:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_14.jpg HTTP/1.1" 201 0
2025-12-04 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1249898-4008614-1000.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1249898-4008614-1000.jpg saved to cache
2025-12-04 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f69bc873-1269-58a9-a911-771cacf24f5d
2025-12-04 20:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924b1cd0>
2025-12-04 20:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_12.jpg HTTP/1.1" 201 0
2025-12-04 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f30e2ea-5828-4377-bc71-79cf417402d7_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_4.jpg saved to cache
2025-12-04 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f69bc873-1269-58a9-a911-771cacf24f5d
2025-12-04 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa764fc79-a021-4dde-b2b5-7474b5669ca7_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_1.jpg not downloaded yet
2025-12-04 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa764fc79-a021-4dde-b2b5-7474b5669ca7_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_5.jpg not downloaded yet
2025-12-04 20:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92347d50>
2025-12-04 20:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_13.jpg HTTP/1.1" 201 0
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1249898-4008614-13.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1249898-4008614-13.jpg saved to cache
2025-12-04 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f69bc873-1269-58a9-a911-771cacf24f5d
2025-12-04 20:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c922bd090>
2025-12-04 20:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_15.jpg HTTP/1.1" 201 0
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1249898-4008614-1001.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1249898-4008614-1001.jpg saved to cache
2025-12-04 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item f69bc873-1269-58a9-a911-771cacf24f5d
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa764fc79-a021-4dde-b2b5-7474b5669ca7_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_4.jpg not downloaded yet
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa764fc79-a021-4dde-b2b5-7474b5669ca7_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_11.jpg not downloaded yet
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa764fc79-a021-4dde-b2b5-7474b5669ca7_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_10.jpg not downloaded yet
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa764fc79-a021-4dde-b2b5-7474b5669ca7_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_9.jpg not downloaded yet
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa764fc79-a021-4dde-b2b5-7474b5669ca7_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_2.jpg not downloaded yet
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa764fc79-a021-4dde-b2b5-7474b5669ca7_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_5.jpg not downloaded yet
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa764fc79-a021-4dde-b2b5-7474b5669ca7_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_3.jpg not downloaded yet
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa764fc79-a021-4dde-b2b5-7474b5669ca7_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_4.jpg not downloaded yet
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1318037-4008462-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-13.jpg not downloaded yet
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1318037-4008462-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1000.jpg not downloaded yet
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1318037-4008462-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1001.jpg not downloaded yet
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1318037-4008462-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1002.jpg not downloaded yet
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1318037-4008462-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1003.jpg not downloaded yet
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1318037-4008462-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1004.jpg not downloaded yet
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1318037-4008462-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1005.jpg not downloaded yet
2025-12-04 20:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001410764-01992710-002.pdf> (referer: None)
2025-12-04 20:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a70490>
2025-12-04 20:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_expert_report_file_802dd0d1-2272-4f1c-afe5-60804f0e019a.pdf HTTP/1.1" 201 0
2025-12-04 20:01:29 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf
2025-12-04 20:01:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf, skipping ID generation
2025-12-04 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_7.jpg not downloaded yet
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_7.jpg not downloaded yet
2025-12-04 20:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001318037-01991292-002.pdf)
2025-12-04 20:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001318037-01991292-002.pdf)
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_6.jpg not downloaded yet
2025-12-04 20:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001318037-01991292-002.pdf)
2025-12-04 20:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001318037-01991292-002.pdf)
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_1.jpg not downloaded yet
2025-12-04 20:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001318037-01991292-002.pdf)
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_5.jpg not downloaded yet
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_4.jpg not downloaded yet
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_11.jpg not downloaded yet
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_10.jpg not downloaded yet
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_9.jpg not downloaded yet
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_2.jpg not downloaded yet
2025-12-04 20:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92107010>
2025-12-04 20:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_15.jpg HTTP/1.1" 201 0
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1318037-4008462-1001.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1001.jpg saved to cache
2025-12-04 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 9834b75b-9b16-585b-86ba-6806a78a5d4d
2025-12-04 20:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c921eb890>
2025-12-04 20:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_16.jpg HTTP/1.1" 201 0
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1318037-4008462-1002.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1002.jpg saved to cache
2025-12-04 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 9834b75b-9b16-585b-86ba-6806a78a5d4d
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_5.jpg not downloaded yet
2025-12-04 20:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92107290>
2025-12-04 20:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_17.jpg HTTP/1.1" 201 0
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1318037-4008462-1003.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1003.jpg saved to cache
2025-12-04 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 9834b75b-9b16-585b-86ba-6806a78a5d4d
2025-12-04 20:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a94b10>
2025-12-04 20:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_19.jpg HTTP/1.1" 201 0
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1318037-4008462-1005.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1005.jpg saved to cache
2025-12-04 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 9834b75b-9b16-585b-86ba-6806a78a5d4d
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_3.jpg not downloaded yet
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_4.jpg not downloaded yet
2025-12-04 20:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c921c0810>
2025-12-04 20:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_18.jpg HTTP/1.1" 201 0
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1318037-4008462-1004.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1004.jpg saved to cache
2025-12-04 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 9834b75b-9b16-585b-86ba-6806a78a5d4d
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1410764-4008206-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1410764-4008206-13.jpg not downloaded yet
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1410764-4008206-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1410764-4008206-1000.jpg not downloaded yet
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1410764-4008206-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1410764-4008206-1001.jpg not downloaded yet
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1410764-4008206-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1410764-4008206-1002.jpg not downloaded yet
2025-12-04 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1410764-4008206-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1410764-4008206-1003.jpg not downloaded yet
2025-12-04 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1410764-4008206-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1410764-4008206-1004.jpg not downloaded yet
2025-12-04 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1410764-4008206-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1410764-4008206-1005.jpg not downloaded yet
2025-12-04 20:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1410764-4008206-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001410764-01992710-002.pdf)
2025-12-04 20:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1410764-4008206-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001410764-01992710-002.pdf)
2025-12-04 20:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1410764-4008206-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001410764-01992710-002.pdf)
2025-12-04 20:01:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9205b710>
2025-12-04 20:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_18.jpg HTTP/1.1" 201 0
2025-12-04 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1410764-4008206-1004.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1410764-4008206-1004.jpg saved to cache
2025-12-04 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf
2025-12-04 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1410764-4008206-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001410764-01992710-002.pdf)
2025-12-04 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1410764-4008206-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001410764-01992710-002.pdf)
2025-12-04 20:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a52450>
2025-12-04 20:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_17.jpg HTTP/1.1" 201 0
2025-12-04 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1410764-4008206-1003.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1410764-4008206-1003.jpg saved to cache
2025-12-04 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf
2025-12-04 20:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924b0690>
2025-12-04 20:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_15.jpg HTTP/1.1" 201 0
2025-12-04 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1410764-4008206-1001.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1410764-4008206-1001.jpg saved to cache
2025-12-04 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf
2025-12-04 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1410764-4008206-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001410764-01992710-002.pdf)
2025-12-04 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001410764-01992710-002.pdf)
2025-12-04 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001410764-01992710-002.pdf)
2025-12-04 20:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924cbdd0>
2025-12-04 20:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_19.jpg HTTP/1.1" 201 0
2025-12-04 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1410764-4008206-1005.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1410764-4008206-1005.jpg saved to cache
2025-12-04 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf
2025-12-04 20:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c920c05d0>
2025-12-04 20:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_16.jpg HTTP/1.1" 201 0
2025-12-04 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1410764-4008206-1002.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1410764-4008206-1002.jpg saved to cache
2025-12-04 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf
2025-12-04 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1410764-4008206-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001410764-01992710-002.pdf)
2025-12-04 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001410764-01992710-002.pdf)
2025-12-04 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001410764-01992710-002.pdf)
2025-12-04 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001410764-01992710-002.pdf)
2025-12-04 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001410764-01992710-002.pdf)
2025-12-04 20:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92360cd0>
2025-12-04 20:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_13.jpg HTTP/1.1" 201 0
2025-12-04 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1410764-4008206-13.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1410764-4008206-13.jpg saved to cache
2025-12-04 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf
2025-12-04 20:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a8fe50>
2025-12-04 20:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_12.jpg HTTP/1.1" 201 0
2025-12-04 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_4.jpg saved to cache
2025-12-04 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf
2025-12-04 20:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9202abd0>
2025-12-04 20:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_11.jpg HTTP/1.1" 201 0
2025-12-04 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_3.jpg saved to cache
2025-12-04 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf
2025-12-04 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001410764-01992710-002.pdf)
2025-12-04 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001410764-01992710-002.pdf)
2025-12-04 20:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92359b10>
2025-12-04 20:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_14.jpg HTTP/1.1" 201 0
2025-12-04 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1410764-4008206-1000.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1410764-4008206-1000.jpg saved to cache
2025-12-04 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf
2025-12-04 20:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c925d05d0>
2025-12-04 20:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_7.jpg HTTP/1.1" 201 0
2025-12-04 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_10.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_10.jpg saved to cache
2025-12-04 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf
2025-12-04 20:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91bf0ad0>
2025-12-04 20:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_6.jpg HTTP/1.1" 201 0
2025-12-04 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_11.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_11.jpg saved to cache
2025-12-04 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf
2025-12-04 20:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91bf1210>
2025-12-04 20:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_8.jpg HTTP/1.1" 201 0
2025-12-04 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_9.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_9.jpg saved to cache
2025-12-04 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf
2025-12-04 20:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92094990>
2025-12-04 20:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_10.jpg HTTP/1.1" 201 0
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_5.jpg saved to cache
2025-12-04 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf
2025-12-04 20:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001410764-01992710-002.pdf)
2025-12-04 20:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001410764-01992710-002.pdf)
2025-12-04 20:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001410764-01992710-002.pdf)
2025-12-04 20:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001410764-01992710-002.pdf)
2025-12-04 20:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001410764-01992710-002.pdf)
2025-12-04 20:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a90dd0>
2025-12-04 20:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_9.jpg HTTP/1.1" 201 0
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_2.jpg saved to cache
2025-12-04 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf
2025-12-04 20:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924ca590>
2025-12-04 20:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_5.jpg HTTP/1.1" 201 0
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_4.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_4.jpg saved to cache
2025-12-04 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf
2025-12-04 20:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001318037-01991292-002.pdf)
2025-12-04 20:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c923b8950>
2025-12-04 20:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_4.jpg HTTP/1.1" 201 0
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_5.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_5.jpg saved to cache
2025-12-04 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf
2025-12-04 20:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92286810>
2025-12-04 20:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_2.jpg HTTP/1.1" 201 0
2025-12-04 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_6.jpg saved to cache
2025-12-04 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf
2025-12-04 20:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c922ca4d0>
2025-12-04 20:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_0.jpg HTTP/1.1" 201 0
2025-12-04 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_7.jpg saved to cache
2025-12-04 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf
2025-12-04 20:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9244c810>
2025-12-04 20:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_3.jpg HTTP/1.1" 201 0
2025-12-04 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_1.jpg saved to cache
2025-12-04 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf
2025-12-04 20:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9240b1d0>
2025-12-04 20:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_1.jpg HTTP/1.1" 201 0
2025-12-04 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_7.jpg saved to cache
2025-12-04 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf
2025-12-04 20:01:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf, skipping ID generation
2025-12-04 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf from tracking dictionaries
2025-12-04 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf sending to next pipeline
2025-12-04 20:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf, identifier: 1410764
2025-12-04 20:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf with identifier: 1410764
2025-12-04 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 20:01:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLACK HTTP/1.1" 200 None
2025-12-04 20:01:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 20:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf with identifier: 1410764
2025-12-04 20:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 163071 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163071
2025-12-04 20:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf spider: manheim.gb
2025-12-04 20:01:37 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf due to rule: high_mileage_for_country.json, error: 163071 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163071
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_expert_report_file_802dd0d1-2272-4f1c-afe5-60804f0e019a.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001410764-01992710-002.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KR59VZB',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/POLO?id=1410764',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'VOLKSWAGEN',
 'model': 'POLO',
 'odometer': 101328,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 62,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201282,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201282,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221896,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236657,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203163,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186510,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 181391,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 182883,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186212,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281105,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238588,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288297,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297293,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9e7cb33c-ea19-4b02-8ef8-eae8677f0c23_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325291,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1410764-4008206-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304864,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1410764-4008206-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297954,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1410764-4008206-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239375,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1410764-4008206-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209663,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1410764-4008206-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 188933,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1410764-4008206-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf/33e41bbf-84c6-591b-a3ce-95e9ed2c9bdf_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351360,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1410764-4008206-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-15',
 'seller_name': 'Days Motor Group',
 'title': 'VOLKSWAGEN POLO 1.2 Match 60 5dr',
 'transmission': 'manual',
 'trim': '1.2 Match 60 5dr',
 'year': 2009}
2025-12-04 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271410764%27 HTTP/1.1" 200 None
2025-12-04 20:01:37 [manheim.gb] INFO: Saving data for 1410764: {'created_time': 1764878497.754718, 'last_price_update_time': 1764878497.754731, 'auction_closing_time': 1765184400.0}
2025-12-04 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1410764') HTTP/1.1" 204 0
2025-12-04 20:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001318037-01991292-002.pdf)
2025-12-04 20:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001318037-01991292-002.pdf)
2025-12-04 20:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001318037-01991292-002.pdf)
2025-12-04 20:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001318037-01991292-002.pdf)
2025-12-04 20:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001318037-01991292-002.pdf)
2025-12-04 20:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924a7ad0>
2025-12-04 20:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_14.jpg HTTP/1.1" 201 0
2025-12-04 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1318037-4008462-1000.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1000.jpg saved to cache
2025-12-04 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 9834b75b-9b16-585b-86ba-6806a78a5d4d
2025-12-04 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001318037-01991292-002.pdf)
2025-12-04 20:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91b9d690>
2025-12-04 20:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_13.jpg HTTP/1.1" 201 0
2025-12-04 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1318037-4008462-13.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-13.jpg saved to cache
2025-12-04 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9834b75b-9b16-585b-86ba-6806a78a5d4d
2025-12-04 20:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91ba8ad0>
2025-12-04 20:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_11.jpg HTTP/1.1" 201 0
2025-12-04 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa764fc79-a021-4dde-b2b5-7474b5669ca7_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_3.jpg saved to cache
2025-12-04 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9834b75b-9b16-585b-86ba-6806a78a5d4d
2025-12-04 20:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92269510>
2025-12-04 20:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_10.jpg HTTP/1.1" 201 0
2025-12-04 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa764fc79-a021-4dde-b2b5-7474b5669ca7_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_5.jpg saved to cache
2025-12-04 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9834b75b-9b16-585b-86ba-6806a78a5d4d
2025-12-04 20:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c922d7710>
2025-12-04 20:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_12.jpg HTTP/1.1" 201 0
2025-12-04 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa764fc79-a021-4dde-b2b5-7474b5669ca7_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_4.jpg saved to cache
2025-12-04 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9834b75b-9b16-585b-86ba-6806a78a5d4d
2025-12-04 20:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92166490>
2025-12-04 20:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_8.jpg HTTP/1.1" 201 0
2025-12-04 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa764fc79-a021-4dde-b2b5-7474b5669ca7_9.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_9.jpg saved to cache
2025-12-04 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9834b75b-9b16-585b-86ba-6806a78a5d4d
2025-12-04 20:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001318037-01991292-002.pdf)
2025-12-04 20:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001318037-01991292-002.pdf)
2025-12-04 20:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001318037-01991292-002.pdf)
2025-12-04 20:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001318037-01991292-002.pdf)
2025-12-04 20:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001318037-01991292-002.pdf)
2025-12-04 20:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001318037-01991292-002.pdf)
2025-12-04 20:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91ba2010>
2025-12-04 20:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_9.jpg HTTP/1.1" 201 0
2025-12-04 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa764fc79-a021-4dde-b2b5-7474b5669ca7_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_2.jpg saved to cache
2025-12-04 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9834b75b-9b16-585b-86ba-6806a78a5d4d
2025-12-04 20:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92270ed0>
2025-12-04 20:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_5.jpg HTTP/1.1" 201 0
2025-12-04 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa764fc79-a021-4dde-b2b5-7474b5669ca7_4.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_4.jpg saved to cache
2025-12-04 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9834b75b-9b16-585b-86ba-6806a78a5d4d
2025-12-04 20:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91aef050>
2025-12-04 20:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_4.jpg HTTP/1.1" 201 0
2025-12-04 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa764fc79-a021-4dde-b2b5-7474b5669ca7_5.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_5.jpg saved to cache
2025-12-04 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9834b75b-9b16-585b-86ba-6806a78a5d4d
2025-12-04 20:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92106350>
2025-12-04 20:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_6.jpg HTTP/1.1" 201 0
2025-12-04 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa764fc79-a021-4dde-b2b5-7474b5669ca7_11.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_11.jpg saved to cache
2025-12-04 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9834b75b-9b16-585b-86ba-6806a78a5d4d
2025-12-04 20:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92273b10>
2025-12-04 20:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_7.jpg HTTP/1.1" 201 0
2025-12-04 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa764fc79-a021-4dde-b2b5-7474b5669ca7_10.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_10.jpg saved to cache
2025-12-04 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9834b75b-9b16-585b-86ba-6806a78a5d4d
2025-12-04 20:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92271010>
2025-12-04 20:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_3.jpg HTTP/1.1" 201 0
2025-12-04 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa764fc79-a021-4dde-b2b5-7474b5669ca7_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_1.jpg saved to cache
2025-12-04 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9834b75b-9b16-585b-86ba-6806a78a5d4d
2025-12-04 20:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92346cd0>
2025-12-04 20:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 20:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_2.jpg HTTP/1.1" 201 0
2025-12-04 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa764fc79-a021-4dde-b2b5-7474b5669ca7_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_6.jpg saved to cache
2025-12-04 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9834b75b-9b16-585b-86ba-6806a78a5d4d
2025-12-04 20:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1249898-4008614-1005.jpg> (referer: None)
2025-12-04 20:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001318037-01991292-002.pdf)
2025-12-04 20:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001318037-01991292-002.pdf)
2025-12-04 20:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1249898-4008614-1003.jpg> (referer: None)
2025-12-04 20:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1249898-4008614-1002.jpg> (referer: None)
2025-12-04 20:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1249898-4008614-1004.jpg> (referer: None)
2025-12-04 20:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c93713710>
2025-12-04 20:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_19.jpg HTTP/1.1" 201 0
2025-12-04 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1249898-4008614-1005.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1249898-4008614-1005.jpg saved to cache
2025-12-04 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item f69bc873-1269-58a9-a911-771cacf24f5d
2025-12-04 20:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a5d290>
2025-12-04 20:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_0.jpg HTTP/1.1" 201 0
2025-12-04 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa764fc79-a021-4dde-b2b5-7474b5669ca7_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_7.jpg saved to cache
2025-12-04 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9834b75b-9b16-585b-86ba-6806a78a5d4d
2025-12-04 20:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c920ed590>
2025-12-04 20:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_1.jpg HTTP/1.1" 201 0
2025-12-04 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa764fc79-a021-4dde-b2b5-7474b5669ca7_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_7.jpg saved to cache
2025-12-04 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9834b75b-9b16-585b-86ba-6806a78a5d4d
2025-12-04 20:01:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9834b75b-9b16-585b-86ba-6806a78a5d4d, skipping ID generation
2025-12-04 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9834b75b-9b16-585b-86ba-6806a78a5d4d from tracking dictionaries
2025-12-04 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9834b75b-9b16-585b-86ba-6806a78a5d4d sending to next pipeline
2025-12-04 20:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 9834b75b-9b16-585b-86ba-6806a78a5d4d, identifier: 1318037
2025-12-04 20:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924a5f10>
2025-12-04 20:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_17.jpg HTTP/1.1" 201 0
2025-12-04 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1249898-4008614-1003.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1249898-4008614-1003.jpg saved to cache
2025-12-04 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item f69bc873-1269-58a9-a911-771cacf24f5d
2025-12-04 20:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c922f2290>
2025-12-04 20:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_16.jpg HTTP/1.1" 201 0
2025-12-04 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1249898-4008614-1002.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1249898-4008614-1002.jpg saved to cache
2025-12-04 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item f69bc873-1269-58a9-a911-771cacf24f5d
2025-12-04 20:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c920ef410>
2025-12-04 20:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_18.jpg HTTP/1.1" 201 0
2025-12-04 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1249898-4008614-1004.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1249898-4008614-1004.jpg saved to cache
2025-12-04 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item f69bc873-1269-58a9-a911-771cacf24f5d
2025-12-04 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_3.jpg> (referer: None)
2025-12-04 20:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 9834b75b-9b16-585b-86ba-6806a78a5d4d with identifier: 1318037
2025-12-04 20:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 9834b75b-9b16-585b-86ba-6806a78a5d4d with identifier: 1318037
2025-12-04 20:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 44, 'seller_name': 'hendy group', 'price_includes_vat': False, 'title': 'kia sportage 1.6 gdi 1 5dr', 'price': 0, 'currency': 'gbp', 'make': 'kia', 'model': 'sportage', 'transmission': 'manual', 'engine': '1.6l', 'fuel_type': 'petrol', 'odometer': 156393, 'odometer_reading_unit': 'mi', 'registration_date': '2015-03-07', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/kia/sportage?id=1318037', 'location': 'bristol', 'origin_country_code': 'gb', 'trim': '1.6 gdi 1 5dr', 'license_plate': 'hf15vrg', 'year': 2015, 'listing': 'auction', 'c_o_2_emission_value': 158, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001318037-01991292-002.pdf', 'expiration_date': '2025-12-08t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '9834b75b-9b16-585b-86ba-6806a78a5d4d', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_expert_report_file_991eecd3-5c73-451c-bb64-5ae6aea0f355.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 190520}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 190520}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 214964}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 201990}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 165546}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 161992}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 167789}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 182186}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 178908}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 275848}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 229065}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 229189}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 251694}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 224960}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 194785}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 148357}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 162812}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 201391}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 233671}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 218039}], 'current_year_diff': 10, 'age_in_months': 128, 'make_model': 'kia sportage', 'sanitized_make': 'kia', 'odometer_in_km': 251689}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 128,
     'auction_title': '',
     'c_o_2_emission_value': 158,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_expert_report_file_991eecd3-5c73-451c-bb64-5ae6aea0f355.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001318037-01991292-002.pdf',
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 10,
     'engine': '1.6l',
     'expiration_date': '2025-12-08t09:00:00z',
     'fuel_type': 'petrol',
     'id': '9834b75b-9b16-585b-86ba-6806a78a5d4d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'hf15vrg',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/kia/sportage?id=1318037',
     'listing': 'auction',
     'location': 'bristol',
     'make': 'kia',
     'make_model': 'kia sportage',
     'model': 'sportage',
     'odometer': 156393,
     'odometer_in_km': 251689,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 44,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 190520,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 190520,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 214964,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 201990,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 165546,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 161992,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 167789,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_11.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 182186,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_10.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 178908,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_9.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 275848,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 229065,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 229189,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 251694,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 224960,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-13.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 194785,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1000.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 148357,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 162812,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1002.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 201391,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1003.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 233671,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1004.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 218039,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1005.jpg',
                 'Width': 1333}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2015-03-07',
     'sanitized_make': 'kia',
     'seller_name': 'hendy group',
     'title': 'kia sportage 1.6 gdi 1 5dr',
     'transmission': 'manual',
     'trim': '1.6 gdi 1 5dr',
     'year': 2015}
2025-12-04 20:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 9834b75b-9b16-585b-86ba-6806a78a5d4d spider: manheim.gb
2025-12-04 20:01:42 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 9834b75b-9b16-585b-86ba-6806a78a5d4d due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 44, 'seller_name': 'hendy group', 'price_includes_vat': False, 'title': 'kia sportage 1.6 gdi 1 5dr', 'price': 0, 'currency': 'gbp', 'make': 'kia', 'model': 'sportage', 'transmission': 'manual', 'engine': '1.6l', 'fuel_type': 'petrol', 'odometer': 156393, 'odometer_reading_unit': 'mi', 'registration_date': '2015-03-07', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/kia/sportage?id=1318037', 'location': 'bristol', 'origin_country_code': 'gb', 'trim': '1.6 gdi 1 5dr', 'license_plate': 'hf15vrg', 'year': 2015, 'listing': 'auction', 'c_o_2_emission_value': 158, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001318037-01991292-002.pdf', 'expiration_date': '2025-12-08t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '9834b75b-9b16-585b-86ba-6806a78a5d4d', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_expert_report_file_991eecd3-5c73-451c-bb64-5ae6aea0f355.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 190520}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 190520}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 214964}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 201990}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 165546}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 161992}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 167789}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 182186}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 178908}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 275848}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 229065}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 229189}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 251694}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 224960}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 194785}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 148357}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 162812}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 201391}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 233671}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 218039}], 'current_year_diff': 10, 'age_in_months': 128, 'make_model': 'kia sportage', 'sanitized_make': 'kia', 'odometer_in_km': 251689}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 128,
     'auction_title': '',
     'c_o_2_emission_value': 158,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_expert_report_file_991eecd3-5c73-451c-bb64-5ae6aea0f355.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001318037-01991292-002.pdf',
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 10,
     'engine': '1.6l',
     'expiration_date': '2025-12-08t09:00:00z',
     'fuel_type': 'petrol',
     'id': '9834b75b-9b16-585b-86ba-6806a78a5d4d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'hf15vrg',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/kia/sportage?id=1318037',
     'listing': 'auction',
     'location': 'bristol',
     'make': 'kia',
     'make_model': 'kia sportage',
     'model': 'sportage',
     'odometer': 156393,
     'odometer_in_km': 251689,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 44,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 190520,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 190520,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 214964,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 201990,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 165546,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 161992,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 167789,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_11.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 182186,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_10.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 178908,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_9.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 275848,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 229065,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 229189,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 251694,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 224960,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-13.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 194785,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1000.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 148357,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 162812,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1002.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 201391,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1003.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 233671,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1004.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 218039,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1005.jpg',
                 'Width': 1333}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2015-03-07',
     'sanitized_make': 'kia',
     'seller_name': 'hendy group',
     'title': 'kia sportage 1.6 gdi 1 5dr',
     'transmission': 'manual',
     'trim': '1.6 gdi 1 5dr',
     'year': 2015}
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_expert_report_file_991eecd3-5c73-451c-bb64-5ae6aea0f355.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001318037-01991292-002.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '9834b75b-9b16-585b-86ba-6806a78a5d4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HF15VRG',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/KIA/SPORTAGE?id=1318037',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 156393,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 44,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190520,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190520,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214964,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201990,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 165546,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 161992,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 167789,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 182186,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 178908,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275848,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229065,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229189,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251694,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a764fc79-a021-4dde-b2b5-7474b5669ca7_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224960,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194785,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 148357,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 162812,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201391,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233671,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9834b75b-9b16-585b-86ba-6806a78a5d4d/9834b75b-9b16-585b-86ba-6806a78a5d4d_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218039,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1318037-4008462-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-07',
 'seller_name': 'Hendy Group',
 'title': 'KIA SPORTAGE 1.6 GDi 1 5dr',
 'transmission': 'manual',
 'trim': '1.6 GDi 1 5dr',
 'year': 2015}
2025-12-04 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271318037%27 HTTP/1.1" 200 None
2025-12-04 20:01:42 [manheim.gb] INFO: Saving data for 1318037: {'created_time': 1764878502.989672, 'last_price_update_time': 1764878502.989682, 'auction_closing_time': 1765184400.0}
2025-12-04 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1318037') HTTP/1.1" 204 0
2025-12-04 20:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_5.jpg> (referer: None)
2025-12-04 20:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_7.jpg> (referer: None)
2025-12-04 20:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_10.jpg> (referer: None)
2025-12-04 20:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_2.jpg> (referer: None)
2025-12-04 20:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_9.jpg> (referer: None)
2025-12-04 20:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c94eb9e50>
2025-12-04 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_11.jpg HTTP/1.1" 201 0
2025-12-04 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f30e2ea-5828-4377-bc71-79cf417402d7_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_3.jpg saved to cache
2025-12-04 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f69bc873-1269-58a9-a911-771cacf24f5d
2025-12-04 20:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92131b10>
2025-12-04 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_10.jpg HTTP/1.1" 201 0
2025-12-04 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f30e2ea-5828-4377-bc71-79cf417402d7_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_5.jpg saved to cache
2025-12-04 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f69bc873-1269-58a9-a911-771cacf24f5d
2025-12-04 20:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92097810>
2025-12-04 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_1.jpg HTTP/1.1" 201 0
2025-12-04 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f30e2ea-5828-4377-bc71-79cf417402d7_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_7.jpg saved to cache
2025-12-04 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f69bc873-1269-58a9-a911-771cacf24f5d
2025-12-04 20:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92159710>
2025-12-04 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_7.jpg HTTP/1.1" 201 0
2025-12-04 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f30e2ea-5828-4377-bc71-79cf417402d7_10.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_10.jpg saved to cache
2025-12-04 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f69bc873-1269-58a9-a911-771cacf24f5d
2025-12-04 20:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c920eeb50>
2025-12-04 20:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_9.jpg HTTP/1.1" 201 0
2025-12-04 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f30e2ea-5828-4377-bc71-79cf417402d7_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_2.jpg saved to cache
2025-12-04 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f69bc873-1269-58a9-a911-771cacf24f5d
2025-12-04 20:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91ba3550>
2025-12-04 20:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_8.jpg HTTP/1.1" 201 0
2025-12-04 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f30e2ea-5828-4377-bc71-79cf417402d7_9.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_9.jpg saved to cache
2025-12-04 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f69bc873-1269-58a9-a911-771cacf24f5d
2025-12-04 20:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=1678661&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231678661&indx=39> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 20:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001342103-01987715-002.pdf)
2025-12-04 20:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 20:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001342103-01987715-002.pdf)
2025-12-04 20:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001342103-01987715-002.pdf)
2025-12-04 20:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_7.jpg> (referer: None)
2025-12-04 20:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001342103-01987715-002.pdf)
2025-12-04 20:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001342103-01987715-002.pdf)
2025-12-04 20:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1a58caf-7dc1-5f72-802d-96a885429506 with identifier: 1678661
2025-12-04 20:01:44 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d1a58caf-7dc1-5f72-802d-96a885429506
2025-12-04 20:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/ASTRA?id=1611374&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231611374&indx=36> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 20:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c921e50d0>
2025-12-04 20:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_9.jpg HTTP/1.1" 201 0
2025-12-04 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbd96da05-bb1a-438d-9b7d-57e422063ab3_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_2.jpg saved to cache
2025-12-04 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7eb992b2-0225-549c-ba34-fa3e969cb29a
2025-12-04 20:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c921c3e50>
2025-12-04 20:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_7.jpg HTTP/1.1" 201 0
2025-12-04 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbd96da05-bb1a-438d-9b7d-57e422063ab3_10.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_10.jpg saved to cache
2025-12-04 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7eb992b2-0225-549c-ba34-fa3e969cb29a
2025-12-04 20:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91b8c890>
2025-12-04 20:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_8.jpg HTTP/1.1" 201 0
2025-12-04 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbd96da05-bb1a-438d-9b7d-57e422063ab3_9.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_9.jpg saved to cache
2025-12-04 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7eb992b2-0225-549c-ba34-fa3e969cb29a
2025-12-04 20:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92107e90>
2025-12-04 20:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_0.jpg HTTP/1.1" 201 0
2025-12-04 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1f30e2ea-5828-4377-bc71-79cf417402d7_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_7.jpg saved to cache
2025-12-04 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f69bc873-1269-58a9-a911-771cacf24f5d
2025-12-04 20:01:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f69bc873-1269-58a9-a911-771cacf24f5d, skipping ID generation
2025-12-04 20:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f69bc873-1269-58a9-a911-771cacf24f5d with scrape type 1
2025-12-04 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f69bc873-1269-58a9-a911-771cacf24f5d from tracking dictionaries
2025-12-04 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f69bc873-1269-58a9-a911-771cacf24f5d sending to next pipeline
2025-12-04 20:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f69bc873-1269-58a9-a911-771cacf24f5d, identifier: 1249898
2025-12-04 20:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92130b10>
2025-12-04 20:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_5.jpg HTTP/1.1" 201 0
2025-12-04 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbd96da05-bb1a-438d-9b7d-57e422063ab3_4.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_4.jpg saved to cache
2025-12-04 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7eb992b2-0225-549c-ba34-fa3e969cb29a
2025-12-04 20:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9221bdd0>
2025-12-04 20:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_6.jpg HTTP/1.1" 201 0
2025-12-04 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbd96da05-bb1a-438d-9b7d-57e422063ab3_11.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_11.jpg saved to cache
2025-12-04 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7eb992b2-0225-549c-ba34-fa3e969cb29a
2025-12-04 20:01:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 20:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f69bc873-1269-58a9-a911-771cacf24f5d with identifier: 1249898
2025-12-04 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 20:01:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=WHITE HTTP/1.1" 200 None
2025-12-04 20:01:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 20:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f69bc873-1269-58a9-a911-771cacf24f5d with identifier: 1249898
2025-12-04 20:01:46 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f69bc873-1269-58a9-a911-771cacf24f5d with identifier: 1249898 to the API
2025-12-04 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 20:01:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 20:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'car_expert_report_source_url': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '2.2L',
 'expiration_date': '2025-12-15T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'f69bc873-1269-58a9-a911-771cacf24f5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'FX17NKU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/A%20CLASS?id=1249898',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS',
 'odometer': 52592,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 32,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206397,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206397,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 172402,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204892,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198313,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200519,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 182641,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194096,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202284,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237472,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 146324,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 181366,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208275,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1f30e2ea-5828-4377-bc71-79cf417402d7_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352784,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1249898-4008614-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 149893,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1249898-4008614-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 452045,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1249898-4008614-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203531,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1249898-4008614-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131022,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1249898-4008614-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217542,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1249898-4008614-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc873-1269-58a9-a911-771cacf24f5d/f69bc873-1269-58a9-a911-771cacf24f5d_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122825,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1249898-4008614-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-03',
 'seller_name': 'Oplo CF Limited',
 'title': 'MERCEDES-BENZ A CLASS A200d SE Executive 5dr',
 'transmission': 'manual',
 'trim': 'A200d SE Executive 5dr',
 'year': 2017}
2025-12-04 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271249898%27 HTTP/1.1" 200 None
2025-12-04 20:01:46 [manheim.gb] INFO: Saving data for 1249898: {'created_time': 1764878506.819185, 'last_price_update_time': 1764878506.819196, 'auction_closing_time': 1765789200.0}
2025-12-04 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1249898') HTTP/1.1" 204 0
2025-12-04 20:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/108?id=1727332&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231727332&indx=44> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 20:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=1708581&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231708581&indx=41> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 20:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27d757bc-1759-5ea5-8649-2c42c82809fa with identifier: 1611374
2025-12-04 20:01:46 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 27d757bc-1759-5ea5-8649-2c42c82809fa
2025-12-04 20:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001342103-01987715-002.pdf)
2025-12-04 20:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1603150-4008522-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001603150-01991005-002.pdf)
2025-12-04 20:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1603150-4008522-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001603150-01991005-002.pdf)
2025-12-04 20:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001342103-01987715-002.pdf)
2025-12-04 20:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001342103-01987715-002.pdf)
2025-12-04 20:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001342103-01987715-002.pdf)
2025-12-04 20:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001342103-01987715-002.pdf)
2025-12-04 20:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c2dc58d-aa91-5c90-83b5-39f95868a6b1 with identifier: 1727332
2025-12-04 20:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c2dc58d-aa91-5c90-83b5-39f95868a6b1 with scrape type 1
2025-12-04 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 7c2dc58d-aa91-5c90-83b5-39f95868a6b1
2025-12-04 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fawaiting-image-002.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg already downloaded
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fawaiting-image-002.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg already downloaded
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-3.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-3.jpg not downloaded yet
2025-12-04 20:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81f9a3d9-99a9-5e0d-9d26-d52983783fdf with identifier: 1708581
2025-12-04 20:01:47 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 81f9a3d9-99a9-5e0d-9d26-d52983783fdf
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-13.jpg not downloaded yet
2025-12-04 20:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c923eee50>
2025-12-04 20:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_2.jpg HTTP/1.1" 201 0
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbd96da05-bb1a-438d-9b7d-57e422063ab3_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_6.jpg saved to cache
2025-12-04 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7eb992b2-0225-549c-ba34-fa3e969cb29a
2025-12-04 20:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92378990>
2025-12-04 20:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_19.jpg HTTP/1.1" 201 0
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1603150-4008522-1005.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1603150-4008522-1005.jpg saved to cache
2025-12-04 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 36d1985b-0da7-5cd6-a108-89002b3a47da
2025-12-04 20:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92395790>
2025-12-04 20:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_17.jpg HTTP/1.1" 201 0
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1603150-4008522-1003.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1603150-4008522-1003.jpg saved to cache
2025-12-04 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 36d1985b-0da7-5cd6-a108-89002b3a47da
2025-12-04 20:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9237ae10>
2025-12-04 20:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_4.jpg HTTP/1.1" 201 0
2025-12-04 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbd96da05-bb1a-438d-9b7d-57e422063ab3_5.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_5.jpg saved to cache
2025-12-04 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7eb992b2-0225-549c-ba34-fa3e969cb29a
2025-12-04 20:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92314190>
2025-12-04 20:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_0.jpg HTTP/1.1" 201 0
2025-12-04 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbd96da05-bb1a-438d-9b7d-57e422063ab3_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_7.jpg saved to cache
2025-12-04 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7eb992b2-0225-549c-ba34-fa3e969cb29a
2025-12-04 20:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92394390>
2025-12-04 20:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_1.jpg HTTP/1.1" 201 0
2025-12-04 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbd96da05-bb1a-438d-9b7d-57e422063ab3_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_7.jpg saved to cache
2025-12-04 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7eb992b2-0225-549c-ba34-fa3e969cb29a
2025-12-04 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1000.jpg not downloaded yet
2025-12-04 20:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92230850>
2025-12-04 20:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_3.jpg HTTP/1.1" 201 0
2025-12-04 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbd96da05-bb1a-438d-9b7d-57e422063ab3_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_1.jpg saved to cache
2025-12-04 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7eb992b2-0225-549c-ba34-fa3e969cb29a
2025-12-04 20:01:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7eb992b2-0225-549c-ba34-fa3e969cb29a, skipping ID generation
2025-12-04 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7eb992b2-0225-549c-ba34-fa3e969cb29a from tracking dictionaries
2025-12-04 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7eb992b2-0225-549c-ba34-fa3e969cb29a sending to next pipeline
2025-12-04 20:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 7eb992b2-0225-549c-ba34-fa3e969cb29a, identifier: 1342103
2025-12-04 20:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1603150-4008522-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001603150-01991005-002.pdf)
2025-12-04 20:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 7eb992b2-0225-549c-ba34-fa3e969cb29a with identifier: 1342103
2025-12-04 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 20:01:48 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=SILVER HTTP/1.1" 200 None
2025-12-04 20:01:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 20:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 7eb992b2-0225-549c-ba34-fa3e969cb29a with identifier: 1342103
2025-12-04 20:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 11 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    11
2025-12-04 20:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 7eb992b2-0225-549c-ba34-fa3e969cb29a spider: manheim.gb
2025-12-04 20:01:49 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 7eb992b2-0225-549c-ba34-fa3e969cb29a due to rule: registration_date_old.json, error: 11 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    11
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_expert_report_file_ddd7870e-0f8b-4696-a713-877c9fccad53.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001342103-01987715-002.pdf',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '7eb992b2-0225-549c-ba34-fa3e969cb29a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'EX64UGK',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=1342103',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 85830,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 74,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269243,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269243,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194389,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 174623,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229826,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210995,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260956,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214823,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247267,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189624,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189315,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184519,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185855,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bd96da05-bb1a-438d-9b7d-57e422063ab3_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314785,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1342103-4008795-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365426,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1342103-4008795-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304175,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1342103-4008795-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328831,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1342103-4008795-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301229,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1342103-4008795-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335976,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1342103-4008795-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7eb992b2-0225-549c-ba34-fa3e969cb29a/7eb992b2-0225-549c-ba34-fa3e969cb29a_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 183053,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1342103-4008795-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-08',
 'seller_name': 'Days Motor Group',
 'title': 'FORD FOCUS 1.6 TDCi 115 Zetec S 5dr',
 'transmission': 'manual',
 'trim': '1.6 TDCi 115 Zetec S 5dr',
 'year': 2014}
2025-12-04 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271342103%27 HTTP/1.1" 200 None
2025-12-04 20:01:49 [manheim.gb] INFO: Saving data for 1342103: {'created_time': 1764878509.304703, 'last_price_update_time': 1764878509.304714, 'auction_closing_time': 1765184400.0}
2025-12-04 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1342103') HTTP/1.1" 204 0
2025-12-04 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1603150-4008522-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001603150-01991005-002.pdf)
2025-12-04 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001603150-01991005-002.pdf)
2025-12-04 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1603150-4008522-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001603150-01991005-002.pdf)
2025-12-04 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001603150-01991005-002.pdf)
2025-12-04 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1001.jpg not downloaded yet
2025-12-04 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001603150-01991005-002.pdf)
2025-12-04 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1603150-4008522-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001603150-01991005-002.pdf)
2025-12-04 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/C3?id=1749068&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231749068&indx=45> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001603150-01991005-002.pdf)
2025-12-04 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1002.jpg not downloaded yet
2025-12-04 20:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9231f990>
2025-12-04 20:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_16.jpg HTTP/1.1" 201 0
2025-12-04 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1603150-4008522-1002.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1603150-4008522-1002.jpg saved to cache
2025-12-04 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 36d1985b-0da7-5cd6-a108-89002b3a47da
2025-12-04 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1003.jpg not downloaded yet
2025-12-04 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001611374-01986803-001.pdf> (referer: None)
2025-12-04 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1004.jpg not downloaded yet
2025-12-04 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=2029104&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232029104&indx=58> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1000.jpg> (referer: None)
2025-12-04 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001603150-01991005-002.pdf)
2025-12-04 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001603150-01991005-002.pdf)
2025-12-04 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1005.jpg not downloaded yet
2025-12-04 20:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924b6550>
2025-12-04 20:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_14.jpg HTTP/1.1" 201 0
2025-12-04 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1603150-4008522-1000.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1603150-4008522-1000.jpg saved to cache
2025-12-04 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 36d1985b-0da7-5cd6-a108-89002b3a47da
2025-12-04 20:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924d3950>
2025-12-04 20:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_9.jpg HTTP/1.1" 201 0
2025-12-04 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_2.jpg saved to cache
2025-12-04 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 36d1985b-0da7-5cd6-a108-89002b3a47da
2025-12-04 20:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92499b10>
2025-12-04 20:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_15.jpg HTTP/1.1" 201 0
2025-12-04 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1603150-4008522-1001.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1603150-4008522-1001.jpg saved to cache
2025-12-04 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 36d1985b-0da7-5cd6-a108-89002b3a47da
2025-12-04 20:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924e7e10>
2025-12-04 20:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_8.jpg HTTP/1.1" 201 0
2025-12-04 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e3033fa-0be7-4291-9cae-f72b6d2a22db_9.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_9.jpg saved to cache
2025-12-04 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 36d1985b-0da7-5cd6-a108-89002b3a47da
2025-12-04 20:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924b8dd0>
2025-12-04 20:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_11.jpg HTTP/1.1" 201 0
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_3.jpg saved to cache
2025-12-04 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 36d1985b-0da7-5cd6-a108-89002b3a47da
2025-12-04 20:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924dfd90>
2025-12-04 20:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_13.jpg HTTP/1.1" 201 0
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1603150-4008522-13.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1603150-4008522-13.jpg saved to cache
2025-12-04 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 36d1985b-0da7-5cd6-a108-89002b3a47da
2025-12-04 20:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0869b99e-218c-575f-9f79-5af58d9fe54c with identifier: 1749068
2025-12-04 20:01:51 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0869b99e-218c-575f-9f79-5af58d9fe54c
2025-12-04 20:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924d1e50>
2025-12-04 20:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_12.jpg HTTP/1.1" 201 0
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_4.jpg saved to cache
2025-12-04 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 36d1985b-0da7-5cd6-a108-89002b3a47da
2025-12-04 20:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-13.jpg> (referer: None)
2025-12-04 20:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001603150-01991005-002.pdf)
2025-12-04 20:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001603150-01991005-002.pdf)
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1006.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1006.jpg not downloaded yet
2025-12-04 20:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/KIA/PICANTO?id=2057516&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232057516&indx=59> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 20:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1001.jpg> (referer: None)
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1007.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1007.jpg not downloaded yet
2025-12-04 20:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-3.jpg> (referer: None)
2025-12-04 20:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1003.jpg> (referer: None)
2025-12-04 20:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91aaebd0>
2025-12-04 20:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27d757bc-1759-5ea5-8649-2c42c82809fa/27d757bc-1759-5ea5-8649-2c42c82809fa_expert_report_file_0af36c3e-df25-41ed-872f-94876e4a95f8.pdf HTTP/1.1" 201 0
2025-12-04 20:01:51 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 27d757bc-1759-5ea5-8649-2c42c82809fa
2025-12-04 20:01:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27d757bc-1759-5ea5-8649-2c42c82809fa, skipping ID generation
2025-12-04 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 27d757bc-1759-5ea5-8649-2c42c82809fa
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fawaiting-image-002.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg already downloaded
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fawaiting-image-002.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg already downloaded
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1611374-4008257-3.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1611374-4008257-3.jpg not downloaded yet
2025-12-04 20:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf5328e4-df40-5970-8131-df34e67a1910 with identifier: 2029104
2025-12-04 20:01:51 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item cf5328e4-df40-5970-8131-df34e67a1910
2025-12-04 20:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91aae110>
2025-12-04 20:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_4.jpg HTTP/1.1" 201 0
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1000.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1000.jpg saved to cache
2025-12-04 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7c2dc58d-aa91-5c90-83b5-39f95868a6b1
2025-12-04 20:01:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92195f90>
2025-12-04 20:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_4.jpg HTTP/1.1" 201 0
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e3033fa-0be7-4291-9cae-f72b6d2a22db_5.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_5.jpg saved to cache
2025-12-04 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36d1985b-0da7-5cd6-a108-89002b3a47da
2025-12-04 20:01:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92257c90>
2025-12-04 20:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_5.jpg HTTP/1.1" 201 0
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e3033fa-0be7-4291-9cae-f72b6d2a22db_4.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_4.jpg saved to cache
2025-12-04 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 36d1985b-0da7-5cd6-a108-89002b3a47da
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1008.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1008.jpg not downloaded yet
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1611374-4008257-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1611374-4008257-13.jpg not downloaded yet
2025-12-04 20:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1004.jpg> (referer: None)
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1009.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1009.jpg not downloaded yet
2025-12-04 20:01:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924870d0>
2025-12-04 20:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_3.jpg HTTP/1.1" 201 0
2025-12-04 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-13.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-13.jpg saved to cache
2025-12-04 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7c2dc58d-aa91-5c90-83b5-39f95868a6b1
2025-12-04 20:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92344450>
2025-12-04 20:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_7.jpg HTTP/1.1" 201 0
2025-12-04 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e3033fa-0be7-4291-9cae-f72b6d2a22db_10.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_10.jpg saved to cache
2025-12-04 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 36d1985b-0da7-5cd6-a108-89002b3a47da
2025-12-04 20:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91b8dfd0>
2025-12-04 20:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_6.jpg HTTP/1.1" 201 0
2025-12-04 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e3033fa-0be7-4291-9cae-f72b6d2a22db_11.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_11.jpg saved to cache
2025-12-04 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 36d1985b-0da7-5cd6-a108-89002b3a47da
2025-12-04 20:01:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be58e6f6-2608-5d15-be6a-b49e5f011661 with identifier: 2057516
2025-12-04 20:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be58e6f6-2608-5d15-be6a-b49e5f011661 with scrape type 2
2025-12-04 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be58e6f6-2608-5d15-be6a-b49e5f011661 with scrape type 2
2025-12-04 20:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: be58e6f6-2608-5d15-be6a-b49e5f011661, identifier: 2057516
2025-12-04 20:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9207d4d0>
2025-12-04 20:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_5.jpg HTTP/1.1" 201 0
2025-12-04 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1001.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1001.jpg saved to cache
2025-12-04 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7c2dc58d-aa91-5c90-83b5-39f95868a6b1
2025-12-04 20:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924dbb10>
2025-12-04 20:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_2.jpg HTTP/1.1" 201 0
2025-12-04 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-3.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-3.jpg saved to cache
2025-12-04 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7c2dc58d-aa91-5c90-83b5-39f95868a6b1
2025-12-04 20:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c920cd650>
2025-12-04 20:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_7.jpg HTTP/1.1" 201 0
2025-12-04 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1003.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1003.jpg saved to cache
2025-12-04 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7c2dc58d-aa91-5c90-83b5-39f95868a6b1
2025-12-04 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1611374-4008257-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1611374-4008257-1000.jpg not downloaded yet
2025-12-04 20:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: be58e6f6-2608-5d15-be6a-b49e5f011661 with identifier: 2057516
2025-12-04 20:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: be58e6f6-2608-5d15-be6a-b49e5f011661 with identifier: 2057516
2025-12-04 20:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: be58e6f6-2608-5d15-be6a-b49e5f011661 with identifier: 2057516 to the API
2025-12-04 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 20:01:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 20:01:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/KIA/PICANTO?id=2057516&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232057516&indx=59>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002057516-01987882-002.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'be58e6f6-2608-5d15-be6a-b49e5f011661',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'MA66AVZ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/KIA/PICANTO?id=2057516',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'KIA',
 'model': 'PICANTO',
 'odometer': 18176,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-12',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'KIA PICANTO 1.0 65 SE 5dr',
 'transmission': 'manual',
 'trim': '1.0 65 SE 5dr',
 'year': 2016}
2025-12-04 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272057516%27 HTTP/1.1" 200 None
2025-12-04 20:01:54 [manheim.gb] INFO: Saving data for 2057516: {'auction_closing_time': 1765184400.0, 'created_time': 1764662593.645106, 'last_price_update_time': 1764878514.994369}
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2057516') HTTP/1.1" 204 0
2025-12-04 20:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1002.jpg> (referer: None)
2025-12-04 20:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001603150-01991005-002.pdf)
2025-12-04 20:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001603150-01991005-002.pdf)
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1010.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1010.jpg not downloaded yet
2025-12-04 20:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001603150-01991005-002.pdf)
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1611374-4008257-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1611374-4008257-1001.jpg not downloaded yet
2025-12-04 20:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=2058572&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232058572&indx=60> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 20:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c923ed550>
2025-12-04 20:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_8.jpg HTTP/1.1" 201 0
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1004.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1004.jpg saved to cache
2025-12-04 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7c2dc58d-aa91-5c90-83b5-39f95868a6b1
2025-12-04 20:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1005.jpg> (referer: None)
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1011.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1011.jpg not downloaded yet
2025-12-04 20:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1095462-4008069-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001095462-01985949-001.pdf)
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1611374-4008257-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1611374-4008257-1002.jpg not downloaded yet
2025-12-04 20:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1095462-4008069-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001095462-01985949-001.pdf)
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1012.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1012.jpg not downloaded yet
2025-12-04 20:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924ddf10>
2025-12-04 20:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_6.jpg HTTP/1.1" 201 0
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1002.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1002.jpg saved to cache
2025-12-04 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7c2dc58d-aa91-5c90-83b5-39f95868a6b1
2025-12-04 20:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924ce450>
2025-12-04 20:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_3.jpg HTTP/1.1" 201 0
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_1.jpg saved to cache
2025-12-04 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36d1985b-0da7-5cd6-a108-89002b3a47da
2025-12-04 20:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c923bafd0>
2025-12-04 20:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_0.jpg HTTP/1.1" 201 0
2025-12-04 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_7.jpg saved to cache
2025-12-04 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36d1985b-0da7-5cd6-a108-89002b3a47da
2025-12-04 20:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924dc2d0>
2025-12-04 20:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_2.jpg HTTP/1.1" 201 0
2025-12-04 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_6.jpg saved to cache
2025-12-04 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36d1985b-0da7-5cd6-a108-89002b3a47da
2025-12-04 20:01:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36d1985b-0da7-5cd6-a108-89002b3a47da, skipping ID generation
2025-12-04 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 36d1985b-0da7-5cd6-a108-89002b3a47da from tracking dictionaries
2025-12-04 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36d1985b-0da7-5cd6-a108-89002b3a47da sending to next pipeline
2025-12-04 20:01:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 36d1985b-0da7-5cd6-a108-89002b3a47da, identifier: 1603150
2025-12-04 20:01:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2876842-745d-59e6-b4ec-f2a23163a614 with identifier: 2058572
2025-12-04 20:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2876842-745d-59e6-b4ec-f2a23163a614 with scrape type 2
2025-12-04 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2876842-745d-59e6-b4ec-f2a23163a614 with scrape type 2
2025-12-04 20:01:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f2876842-745d-59e6-b4ec-f2a23163a614, identifier: 2058572
2025-12-04 20:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1006.jpg> (referer: None)
2025-12-04 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1611374-4008257-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1611374-4008257-1003.jpg not downloaded yet
2025-12-04 20:01:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 36d1985b-0da7-5cd6-a108-89002b3a47da with identifier: 1603150
2025-12-04 20:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 36d1985b-0da7-5cd6-a108-89002b3a47da with identifier: 1603150
2025-12-04 20:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-04 20:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 36d1985b-0da7-5cd6-a108-89002b3a47da spider: manheim.gb
2025-12-04 20:01:56 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 36d1985b-0da7-5cd6-a108-89002b3a47da due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_expert_report_file_4ea352b8-760d-4248-91ee-9d1ce7dd68da.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001603150-01991005-002.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '36d1985b-0da7-5cd6-a108-89002b3a47da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YY15VPG',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/208?id=1603150',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 86081,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 29,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200533,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200533,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275334,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261071,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 153898,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 168176,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 144299,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 157451,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 156195,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220942,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267154,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265978,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277188,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4e3033fa-0be7-4291-9cae-f72b6d2a22db_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 197645,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1603150-4008522-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263094,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1603150-4008522-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 154723,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1603150-4008522-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130724,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1603150-4008522-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192654,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1603150-4008522-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 172140,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1603150-4008522-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d1985b-0da7-5cd6-a108-89002b3a47da/36d1985b-0da7-5cd6-a108-89002b3a47da_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 169832,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1603150-4008522-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-31',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'PEUGEOT 208 1.0 VTi Access+ 3dr',
 'transmission': 'manual',
 'trim': '1.0 VTi Access+ 3dr',
 'year': 2015}
2025-12-04 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271603150%27 HTTP/1.1" 200 None
2025-12-04 20:01:56 [manheim.gb] INFO: Saving data for 1603150: {'created_time': 1764878516.971424, 'last_price_update_time': 1764878516.971434, 'auction_closing_time': 1765184400.0}
2025-12-04 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1603150') HTTP/1.1" 204 0
2025-12-04 20:01:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f2876842-745d-59e6-b4ec-f2a23163a614 with identifier: 2058572
2025-12-04 20:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f2876842-745d-59e6-b4ec-f2a23163a614 with identifier: 2058572
2025-12-04 20:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f2876842-745d-59e6-b4ec-f2a23163a614 with identifier: 2058572 to the API
2025-12-04 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 20:01:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 20:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=2058572&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232058572&indx=60>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002058572-01614192-001.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-10T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'f2876842-745d-59e6-b4ec-f2a23163a614',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'VA17FZV',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=2058572',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 63555,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-23',
 'seller_name': 'FCA Group',
 'title': 'VOLKSWAGEN GOLF 2.0 TSI 310 R 5dr 4MOTION DSG',
 'transmission': 'automatic',
 'trim': '2.0 TSI 310 R 5dr 4MOTION DSG',
 'year': 2017}
2025-12-04 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272058572%27 HTTP/1.1" 200 None
2025-12-04 20:01:57 [manheim.gb] INFO: Saving data for 2058572: {'auction_closing_time': 1765357200.0, 'created_time': 1764662596.823069, 'last_price_update_time': 1764878517.349058}
2025-12-04 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2058572') HTTP/1.1" 204 0
2025-12-04 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1013.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1013.jpg not downloaded yet
2025-12-04 20:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1008.jpg> (referer: None)
2025-12-04 20:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1095462-4008069-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001095462-01985949-001.pdf)
2025-12-04 20:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1009.jpg> (referer: None)
2025-12-04 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1611374-4008257-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1611374-4008257-1004.jpg not downloaded yet
2025-12-04 20:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1010.jpg> (referer: None)
2025-12-04 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1014.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1014.jpg not downloaded yet
2025-12-04 20:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1611374-4008257-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001611374-01986803-001.pdf)
2025-12-04 20:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c921cf710>
2025-12-04 20:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_9.jpg HTTP/1.1" 201 0
2025-12-04 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1005.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1005.jpg saved to cache
2025-12-04 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7c2dc58d-aa91-5c90-83b5-39f95868a6b1
2025-12-04 20:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924b1110>
2025-12-04 20:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_16.jpg HTTP/1.1" 201 0
2025-12-04 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1095462-4008069-1002.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1095462-4008069-1002.jpg saved to cache
2025-12-04 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item b50bf259-323e-5483-b08f-2e017eb9c2b9
2025-12-04 20:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9371c890>
2025-12-04 20:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_17.jpg HTTP/1.1" 201 0
2025-12-04 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1095462-4008069-1003.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1095462-4008069-1003.jpg saved to cache
2025-12-04 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item b50bf259-323e-5483-b08f-2e017eb9c2b9
2025-12-04 20:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92165910>
2025-12-04 20:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_10.jpg HTTP/1.1" 201 0
2025-12-04 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1006.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1006.jpg saved to cache
2025-12-04 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 7c2dc58d-aa91-5c90-83b5-39f95868a6b1
2025-12-04 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1611374-4008257-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001611374-01986803-001.pdf)
2025-12-04 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1015.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1015.jpg not downloaded yet
2025-12-04 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1611374-4008257-3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001611374-01986803-001.pdf)
2025-12-04 20:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c922d4990>
2025-12-04 20:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_12.jpg HTTP/1.1" 201 0
2025-12-04 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1008.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1008.jpg saved to cache
2025-12-04 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 7c2dc58d-aa91-5c90-83b5-39f95868a6b1
2025-12-04 20:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a68c10>
2025-12-04 20:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_15.jpg HTTP/1.1" 201 0
2025-12-04 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1095462-4008069-1001.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1095462-4008069-1001.jpg saved to cache
2025-12-04 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item b50bf259-323e-5483-b08f-2e017eb9c2b9
2025-12-04 20:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91b99790>
2025-12-04 20:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_13.jpg HTTP/1.1" 201 0
2025-12-04 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1009.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1009.jpg saved to cache
2025-12-04 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 7c2dc58d-aa91-5c90-83b5-39f95868a6b1
2025-12-04 20:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c93917410>
2025-12-04 20:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_14.jpg HTTP/1.1" 201 0
2025-12-04 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1010.jpg') HTTP/1.1" 204 0
2025-12-04 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1010.jpg saved to cache
2025-12-04 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 7c2dc58d-aa91-5c90-83b5-39f95868a6b1
2025-12-04 20:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c921abe50>
2025-12-04 20:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27d757bc-1759-5ea5-8649-2c42c82809fa/27d757bc-1759-5ea5-8649-2c42c82809fa_image_4.jpg HTTP/1.1" 201 0
2025-12-04 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1611374-4008257-1000.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1611374-4008257-1000.jpg saved to cache
2025-12-04 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 27d757bc-1759-5ea5-8649-2c42c82809fa
2025-12-04 20:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1611374-4008257-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001611374-01986803-001.pdf)
2025-12-04 20:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1611374-4008257-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001611374-01986803-001.pdf)
2025-12-04 20:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1011.jpg> (referer: None)
2025-12-04 20:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1611374-4008257-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001611374-01986803-001.pdf)
2025-12-04 20:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1012.jpg> (referer: None)
2025-12-04 20:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1611374-4008257-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001611374-01986803-001.pdf)
2025-12-04 20:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92131310>
2025-12-04 20:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27d757bc-1759-5ea5-8649-2c42c82809fa/27d757bc-1759-5ea5-8649-2c42c82809fa_image_3.jpg HTTP/1.1" 201 0
2025-12-04 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1611374-4008257-13.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1611374-4008257-13.jpg saved to cache
2025-12-04 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 27d757bc-1759-5ea5-8649-2c42c82809fa
2025-12-04 20:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92230b10>
2025-12-04 20:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27d757bc-1759-5ea5-8649-2c42c82809fa/27d757bc-1759-5ea5-8649-2c42c82809fa_image_2.jpg HTTP/1.1" 201 0
2025-12-04 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1611374-4008257-3.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1611374-4008257-3.jpg saved to cache
2025-12-04 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 27d757bc-1759-5ea5-8649-2c42c82809fa
2025-12-04 20:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1007.jpg> (referer: None)
2025-12-04 20:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1013.jpg> (referer: None)
2025-12-04 20:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001095462-01985949-001.pdf)
2025-12-04 20:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1014.jpg> (referer: None)
2025-12-04 20:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1095462-4008069-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001095462-01985949-001.pdf)
2025-12-04 20:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001095462-01985949-001.pdf)
2025-12-04 20:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9249b8d0>
2025-12-04 20:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27d757bc-1759-5ea5-8649-2c42c82809fa/27d757bc-1759-5ea5-8649-2c42c82809fa_image_5.jpg HTTP/1.1" 201 0
2025-12-04 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1611374-4008257-1001.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1611374-4008257-1001.jpg saved to cache
2025-12-04 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 27d757bc-1759-5ea5-8649-2c42c82809fa
2025-12-04 20:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92358310>
2025-12-04 20:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27d757bc-1759-5ea5-8649-2c42c82809fa/27d757bc-1759-5ea5-8649-2c42c82809fa_image_7.jpg HTTP/1.1" 201 0
2025-12-04 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1611374-4008257-1003.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1611374-4008257-1003.jpg saved to cache
2025-12-04 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 27d757bc-1759-5ea5-8649-2c42c82809fa
2025-12-04 20:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9249b3d0>
2025-12-04 20:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_15.jpg HTTP/1.1" 201 0
2025-12-04 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1011.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1011.jpg saved to cache
2025-12-04 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 7c2dc58d-aa91-5c90-83b5-39f95868a6b1
2025-12-04 20:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9235a390>
2025-12-04 20:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27d757bc-1759-5ea5-8649-2c42c82809fa/27d757bc-1759-5ea5-8649-2c42c82809fa_image_6.jpg HTTP/1.1" 201 0
2025-12-04 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1611374-4008257-1002.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1611374-4008257-1002.jpg saved to cache
2025-12-04 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 27d757bc-1759-5ea5-8649-2c42c82809fa
2025-12-04 20:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91ba4c50>
2025-12-04 20:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_16.jpg HTTP/1.1" 201 0
2025-12-04 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1012.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1012.jpg saved to cache
2025-12-04 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 7c2dc58d-aa91-5c90-83b5-39f95868a6b1
2025-12-04 20:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9213e950>
2025-12-04 20:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27d757bc-1759-5ea5-8649-2c42c82809fa/27d757bc-1759-5ea5-8649-2c42c82809fa_image_8.jpg HTTP/1.1" 201 0
2025-12-04 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1611374-4008257-1004.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1611374-4008257-1004.jpg saved to cache
2025-12-04 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 27d757bc-1759-5ea5-8649-2c42c82809fa
2025-12-04 20:02:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27d757bc-1759-5ea5-8649-2c42c82809fa, skipping ID generation
2025-12-04 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 27d757bc-1759-5ea5-8649-2c42c82809fa from tracking dictionaries
2025-12-04 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 27d757bc-1759-5ea5-8649-2c42c82809fa sending to next pipeline
2025-12-04 20:02:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 27d757bc-1759-5ea5-8649-2c42c82809fa, identifier: 1611374
2025-12-04 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1015.jpg> (referer: None)
2025-12-04 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1095462-4008069-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001095462-01985949-001.pdf)
2025-12-04 20:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 27d757bc-1759-5ea5-8649-2c42c82809fa with identifier: 1611374
2025-12-04 20:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 27d757bc-1759-5ea5-8649-2c42c82809fa with identifier: 1611374
2025-12-04 20:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 177376 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    177376
2025-12-04 20:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 27d757bc-1759-5ea5-8649-2c42c82809fa spider: manheim.gb
2025-12-04 20:02:02 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 27d757bc-1759-5ea5-8649-2c42c82809fa due to rule: high_mileage_for_country.json, error: 177376 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    177376
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d757bc-1759-5ea5-8649-2c42c82809fa/27d757bc-1759-5ea5-8649-2c42c82809fa_expert_report_file_0af36c3e-df25-41ed-872f-94876e4a95f8.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001611374-01986803-001.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '27d757bc-1759-5ea5-8649-2c42c82809fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GF62AHX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/ASTRA?id=1611374',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'VAUXHALL',
 'model': 'ASTRA',
 'odometer': 110217,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4622c3ba-5515-5758-814e-2f49e4247fa1/4622c3ba-5515-5758-814e-2f49e4247fa1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
             'Width': 1322},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4622c3ba-5515-5758-814e-2f49e4247fa1/4622c3ba-5515-5758-814e-2f49e4247fa1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
             'Width': 1322},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d757bc-1759-5ea5-8649-2c42c82809fa/27d757bc-1759-5ea5-8649-2c42c82809fa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274148,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1611374-4008257-3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d757bc-1759-5ea5-8649-2c42c82809fa/27d757bc-1759-5ea5-8649-2c42c82809fa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285059,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1611374-4008257-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d757bc-1759-5ea5-8649-2c42c82809fa/27d757bc-1759-5ea5-8649-2c42c82809fa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235897,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1611374-4008257-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d757bc-1759-5ea5-8649-2c42c82809fa/27d757bc-1759-5ea5-8649-2c42c82809fa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272081,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1611374-4008257-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d757bc-1759-5ea5-8649-2c42c82809fa/27d757bc-1759-5ea5-8649-2c42c82809fa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201112,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1611374-4008257-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d757bc-1759-5ea5-8649-2c42c82809fa/27d757bc-1759-5ea5-8649-2c42c82809fa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 163043,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1611374-4008257-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27d757bc-1759-5ea5-8649-2c42c82809fa/27d757bc-1759-5ea5-8649-2c42c82809fa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 150369,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1611374-4008257-1004.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-18',
 'seller_name': 'Hendy Group',
 'title': 'VAUXHALL ASTRA 1.4i 16V Active 5dr',
 'transmission': 'manual',
 'trim': '1.4i 16V Active 5dr',
 'year': 2012}
2025-12-04 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271611374%27 HTTP/1.1" 200 None
2025-12-04 20:02:02 [manheim.gb] INFO: Saving data for 1611374: {'created_time': 1764878522.890426, 'last_price_update_time': 1764878522.890436, 'auction_closing_time': 1765184400.0}
2025-12-04 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1611374') HTTP/1.1" 204 0
2025-12-04 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001678661-01992754-003.pdf> (referer: None)
2025-12-04 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001095462-01985949-001.pdf)
2025-12-04 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001095462-01985949-001.pdf)
2025-12-04 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001095462-01985949-001.pdf)
2025-12-04 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001095462-01985949-001.pdf)
2025-12-04 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001095462-01985949-001.pdf)
2025-12-04 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001095462-01985949-001.pdf)
2025-12-04 20:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924fbf90>
2025-12-04 20:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_11.jpg HTTP/1.1" 201 0
2025-12-04 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1007.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1007.jpg saved to cache
2025-12-04 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 7c2dc58d-aa91-5c90-83b5-39f95868a6b1
2025-12-04 20:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92219ed0>
2025-12-04 20:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_17.jpg HTTP/1.1" 201 0
2025-12-04 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1013.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1013.jpg saved to cache
2025-12-04 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 7c2dc58d-aa91-5c90-83b5-39f95868a6b1
2025-12-04 20:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92362210>
2025-12-04 20:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_11.jpg HTTP/1.1" 201 0
2025-12-04 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_3.jpg saved to cache
2025-12-04 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item b50bf259-323e-5483-b08f-2e017eb9c2b9
2025-12-04 20:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924d1ed0>
2025-12-04 20:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_18.jpg HTTP/1.1" 201 0
2025-12-04 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1014.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1014.jpg saved to cache
2025-12-04 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 7c2dc58d-aa91-5c90-83b5-39f95868a6b1
2025-12-04 20:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91ae2910>
2025-12-04 20:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_14.jpg HTTP/1.1" 201 0
2025-12-04 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1095462-4008069-1000.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1095462-4008069-1000.jpg saved to cache
2025-12-04 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item b50bf259-323e-5483-b08f-2e017eb9c2b9
2025-12-04 20:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924f9510>
2025-12-04 20:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_12.jpg HTTP/1.1" 201 0
2025-12-04 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_4.jpg saved to cache
2025-12-04 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item b50bf259-323e-5483-b08f-2e017eb9c2b9
2025-12-04 20:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924bab10>
2025-12-04 20:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_19.jpg HTTP/1.1" 201 0
2025-12-04 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1727332-4008946-1015.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1015.jpg saved to cache
2025-12-04 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 7c2dc58d-aa91-5c90-83b5-39f95868a6b1
2025-12-04 20:02:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c2dc58d-aa91-5c90-83b5-39f95868a6b1, skipping ID generation
2025-12-04 20:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c2dc58d-aa91-5c90-83b5-39f95868a6b1 with scrape type 1
2025-12-04 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7c2dc58d-aa91-5c90-83b5-39f95868a6b1 from tracking dictionaries
2025-12-04 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c2dc58d-aa91-5c90-83b5-39f95868a6b1 sending to next pipeline
2025-12-04 20:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 7c2dc58d-aa91-5c90-83b5-39f95868a6b1, identifier: 1727332
2025-12-04 20:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9206cad0>
2025-12-04 20:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_13.jpg HTTP/1.1" 201 0
2025-12-04 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1095462-4008069-13.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1095462-4008069-13.jpg saved to cache
2025-12-04 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item b50bf259-323e-5483-b08f-2e017eb9c2b9
2025-12-04 20:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 7c2dc58d-aa91-5c90-83b5-39f95868a6b1 with identifier: 1727332
2025-12-04 20:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 7c2dc58d-aa91-5c90-83b5-39f95868a6b1 with identifier: 1727332
2025-12-04 20:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-04 20:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 7c2dc58d-aa91-5c90-83b5-39f95868a6b1 spider: manheim.gb
2025-12-04 20:02:05 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 7c2dc58d-aa91-5c90-83b5-39f95868a6b1 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'car_expert_report_source_url': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-11T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '7c2dc58d-aa91-5c90-83b5-39f95868a6b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'PX65OCE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/108?id=1727332',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'PEUGEOT',
 'model': '108',
 'odometer': 87670,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4622c3ba-5515-5758-814e-2f49e4247fa1/4622c3ba-5515-5758-814e-2f49e4247fa1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
             'Width': 1322},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4622c3ba-5515-5758-814e-2f49e4247fa1/4622c3ba-5515-5758-814e-2f49e4247fa1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
             'Width': 1322},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236359,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285251,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 175118,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251322,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217167,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210096,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127208,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327787,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1005.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 388129,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1006.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295054,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1007.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291134,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1008.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315781,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1009.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 159294,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1010.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 170742,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1011.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228018,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1012.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322753,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1013.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236852,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1014.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2dc58d-aa91-5c90-83b5-39f95868a6b1/7c2dc58d-aa91-5c90-83b5-39f95868a6b1_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272834,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1727332-4008946-1015.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-01',
 'seller_name': 'Stellantis & You',
 'title': 'PEUGEOT 108 1.0 Active 3dr',
 'transmission': 'manual',
 'trim': '1.0 Active 3dr',
 'year': 2015}
2025-12-04 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271727332%27 HTTP/1.1" 200 None
2025-12-04 20:02:05 [manheim.gb] INFO: Saving data for 1727332: {'created_time': 1764878525.602691, 'last_price_update_time': 1764878525.602702, 'auction_closing_time': 1765443600.0}
2025-12-04 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1727332') HTTP/1.1" 204 0
2025-12-04 20:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 20:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 20:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 20:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001095462-01985949-001.pdf)
2025-12-04 20:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001095462-01985949-001.pdf)
2025-12-04 20:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001095462-01985949-001.pdf)
2025-12-04 20:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9249bc10>
2025-12-04 20:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_expert_report_file_cef54bd7-669d-4f7c-a660-76c3561e76b2.pdf HTTP/1.1" 201 0
2025-12-04 20:02:06 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d1a58caf-7dc1-5f72-802d-96a885429506
2025-12-04 20:02:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1a58caf-7dc1-5f72-802d-96a885429506, skipping ID generation
2025-12-04 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item d1a58caf-7dc1-5f72-802d-96a885429506
2025-12-04 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F628d0664-2e16-4b91-b71f-632d0590280f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_7.jpg not downloaded yet
2025-12-04 20:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a51e50>
2025-12-04 20:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_10.jpg HTTP/1.1" 201 0
2025-12-04 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_5.jpg saved to cache
2025-12-04 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item b50bf259-323e-5483-b08f-2e017eb9c2b9
2025-12-04 20:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a51b90>
2025-12-04 20:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_9.jpg HTTP/1.1" 201 0
2025-12-04 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_2.jpg saved to cache
2025-12-04 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b50bf259-323e-5483-b08f-2e017eb9c2b9
2025-12-04 20:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a539d0>
2025-12-04 20:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_8.jpg HTTP/1.1" 201 0
2025-12-04 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ada0acf-0f16-4947-900c-8b3342e54fb8_9.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_9.jpg saved to cache
2025-12-04 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b50bf259-323e-5483-b08f-2e017eb9c2b9
2025-12-04 20:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a51750>
2025-12-04 20:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_7.jpg HTTP/1.1" 201 0
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ada0acf-0f16-4947-900c-8b3342e54fb8_10.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_10.jpg saved to cache
2025-12-04 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b50bf259-323e-5483-b08f-2e017eb9c2b9
2025-12-04 20:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c922ca790>
2025-12-04 20:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_5.jpg HTTP/1.1" 201 0
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ada0acf-0f16-4947-900c-8b3342e54fb8_4.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_4.jpg saved to cache
2025-12-04 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b50bf259-323e-5483-b08f-2e017eb9c2b9
2025-12-04 20:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91bf2190>
2025-12-04 20:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_6.jpg HTTP/1.1" 201 0
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ada0acf-0f16-4947-900c-8b3342e54fb8_11.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_11.jpg saved to cache
2025-12-04 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b50bf259-323e-5483-b08f-2e017eb9c2b9
2025-12-04 20:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001095462-01985949-001.pdf)
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F628d0664-2e16-4b91-b71f-632d0590280f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_7.jpg not downloaded yet
2025-12-04 20:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002029104-01991886-002.pdf> (referer: None)
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F628d0664-2e16-4b91-b71f-632d0590280f_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_6.jpg not downloaded yet
2025-12-04 20:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001095462-01985949-001.pdf)
2025-12-04 20:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9238f790>
2025-12-04 20:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_3.jpg HTTP/1.1" 201 0
2025-12-04 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_1.jpg saved to cache
2025-12-04 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b50bf259-323e-5483-b08f-2e017eb9c2b9
2025-12-04 20:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92391650>
2025-12-04 20:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_4.jpg HTTP/1.1" 201 0
2025-12-04 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ada0acf-0f16-4947-900c-8b3342e54fb8_5.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_5.jpg saved to cache
2025-12-04 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b50bf259-323e-5483-b08f-2e017eb9c2b9
2025-12-04 20:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c923dd090>
2025-12-04 20:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_2.jpg HTTP/1.1" 201 0
2025-12-04 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_6.jpg saved to cache
2025-12-04 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b50bf259-323e-5483-b08f-2e017eb9c2b9
2025-12-04 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F628d0664-2e16-4b91-b71f-632d0590280f_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_1.jpg not downloaded yet
2025-12-04 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F628d0664-2e16-4b91-b71f-632d0590280f_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_5.jpg not downloaded yet
2025-12-04 20:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001678661-01992754-003.pdf)
2025-12-04 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F628d0664-2e16-4b91-b71f-632d0590280f_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_4.jpg not downloaded yet
2025-12-04 20:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a92e50>
2025-12-04 20:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_1.jpg HTTP/1.1" 201 0
2025-12-04 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_7.jpg saved to cache
2025-12-04 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b50bf259-323e-5483-b08f-2e017eb9c2b9
2025-12-04 20:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92257c90>
2025-12-04 20:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_expert_report_file_de90fb9a-923c-42de-9a65-1060eafe26ee.pdf HTTP/1.1" 201 0
2025-12-04 20:02:09 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item cf5328e4-df40-5970-8131-df34e67a1910
2025-12-04 20:02:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf5328e4-df40-5970-8131-df34e67a1910, skipping ID generation
2025-12-04 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item cf5328e4-df40-5970-8131-df34e67a1910
2025-12-04 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_7.jpg not downloaded yet
2025-12-04 20:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9244d2d0>
2025-12-04 20:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_0.jpg HTTP/1.1" 201 0
2025-12-04 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_7.jpg saved to cache
2025-12-04 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b50bf259-323e-5483-b08f-2e017eb9c2b9
2025-12-04 20:02:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b50bf259-323e-5483-b08f-2e017eb9c2b9, skipping ID generation
2025-12-04 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b50bf259-323e-5483-b08f-2e017eb9c2b9 from tracking dictionaries
2025-12-04 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b50bf259-323e-5483-b08f-2e017eb9c2b9 sending to next pipeline
2025-12-04 20:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: b50bf259-323e-5483-b08f-2e017eb9c2b9, identifier: 1095462
2025-12-04 20:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: b50bf259-323e-5483-b08f-2e017eb9c2b9 with identifier: 1095462
2025-12-04 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 20:02:09 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=White HTTP/1.1" 200 None
2025-12-04 20:02:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 20:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: b50bf259-323e-5483-b08f-2e017eb9c2b9 with identifier: 1095462
2025-12-04 20:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 13 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    13
2025-12-04 20:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: b50bf259-323e-5483-b08f-2e017eb9c2b9 spider: manheim.gb
2025-12-04 20:02:10 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: b50bf259-323e-5483-b08f-2e017eb9c2b9 due to rule: registration_date_old.json, error: 13 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    13
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_expert_report_file_960fb0da-a106-4e5f-a7d4-6400cde2378e.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001095462-01985949-001.pdf',
 'color': 'White',
 'currency': 'GBP',
 'engine': '1.7L',
 'expiration_date': '2025-12-11T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'b50bf259-323e-5483-b08f-2e017eb9c2b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'EK12PXY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/HYUNDAI/IX35?id=1095462',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'HYUNDAI',
 'model': 'IX35',
 'odometer': 88027,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 26,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207909,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207909,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226499,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192726,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198618,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184967,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190228,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 175022,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198134,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232499,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 165478,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195554,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209949,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8ada0acf-0f16-4947-900c-8b3342e54fb8_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276372,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1095462-4008069-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211275,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1095462-4008069-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286594,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1095462-4008069-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194401,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1095462-4008069-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307317,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1095462-4008069-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 163695,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1095462-4008069-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b50bf259-323e-5483-b08f-2e017eb9c2b9/b50bf259-323e-5483-b08f-2e017eb9c2b9_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263650,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1095462-4008069-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-19',
 'seller_name': 'Lookers',
 'title': 'HYUNDAI IX35 1.7 CRDi Style 5dr 2WD',
 'transmission': 'manual',
 'trim': '1.7 CRDi Style 5dr 2WD',
 'year': 2012}
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271095462%27 HTTP/1.1" 200 None
2025-12-04 20:02:10 [manheim.gb] INFO: Saving data for 1095462: {'created_time': 1764878530.07656, 'last_price_update_time': 1764878530.07657, 'auction_closing_time': 1765443600.0}
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1095462') HTTP/1.1" 204 0
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F628d0664-2e16-4b91-b71f-632d0590280f_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_11.jpg not downloaded yet
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_7.jpg not downloaded yet
2025-12-04 20:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c920294d0>
2025-12-04 20:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_0.jpg HTTP/1.1" 201 0
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F628d0664-2e16-4b91-b71f-632d0590280f_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_7.jpg saved to cache
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1a58caf-7dc1-5f72-802d-96a885429506
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F628d0664-2e16-4b91-b71f-632d0590280f_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_10.jpg not downloaded yet
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_6.jpg not downloaded yet
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F628d0664-2e16-4b91-b71f-632d0590280f_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_9.jpg not downloaded yet
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_1.jpg not downloaded yet
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F628d0664-2e16-4b91-b71f-632d0590280f_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_2.jpg not downloaded yet
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F606c4bfb-48f3-4379-9fa3-8f0fe501d175_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_5.jpg not downloaded yet
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F628d0664-2e16-4b91-b71f-632d0590280f_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_5.jpg not downloaded yet
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F606c4bfb-48f3-4379-9fa3-8f0fe501d175_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_4.jpg not downloaded yet
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F628d0664-2e16-4b91-b71f-632d0590280f_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_3.jpg not downloaded yet
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F606c4bfb-48f3-4379-9fa3-8f0fe501d175_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_11.jpg not downloaded yet
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F628d0664-2e16-4b91-b71f-632d0590280f_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_4.jpg not downloaded yet
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F606c4bfb-48f3-4379-9fa3-8f0fe501d175_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_10.jpg not downloaded yet
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1678661-4007948-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1678661-4007948-13.jpg not downloaded yet
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F606c4bfb-48f3-4379-9fa3-8f0fe501d175_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_9.jpg not downloaded yet
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1678661-4007948-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1678661-4007948-1000.jpg not downloaded yet
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_2.jpg not downloaded yet
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1678661-4007948-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1678661-4007948-1001.jpg not downloaded yet
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_5.jpg not downloaded yet
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1678661-4007948-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1678661-4007948-1002.jpg not downloaded yet
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_3.jpg not downloaded yet
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1678661-4007948-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1678661-4007948-1003.jpg not downloaded yet
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_4.jpg not downloaded yet
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1678661-4007948-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1678661-4007948-1004.jpg not downloaded yet
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2029104-4008237-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-13.jpg not downloaded yet
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1678661-4007948-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1678661-4007948-1005.jpg not downloaded yet
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2029104-4008237-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1000.jpg not downloaded yet
2025-12-04 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2029104-4008237-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1001.jpg not downloaded yet
2025-12-04 20:02:11 [scrapy.extensions.logstats] INFO: Crawled 26 pages (at 24 pages/min), scraped 3 items (at 3 items/min)
2025-12-04 20:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001708581-01989056-002.pdf> (referer: None)
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2029104-4008237-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1002.jpg not downloaded yet
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2029104-4008237-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1003.jpg not downloaded yet
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2029104-4008237-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1004.jpg not downloaded yet
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2029104-4008237-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1005.jpg not downloaded yet
2025-12-04 20:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001749068-01985488-002.pdf> (referer: None)
2025-12-04 20:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c921c1a10>
2025-12-04 20:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_expert_report_file_380a71d7-2458-477b-be27-e8be487fd1ce.pdf HTTP/1.1" 201 0
2025-12-04 20:02:11 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 81f9a3d9-99a9-5e0d-9d26-d52983783fdf
2025-12-04 20:02:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 81f9a3d9-99a9-5e0d-9d26-d52983783fdf, skipping ID generation
2025-12-04 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 81f9a3d9-99a9-5e0d-9d26-d52983783fdf
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_7.jpg not downloaded yet
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_7.jpg not downloaded yet
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_6.jpg not downloaded yet
2025-12-04 20:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92257490>
2025-12-04 20:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_expert_report_file_e8b7c497-491d-423f-bf9e-0b1b74cd4174.pdf HTTP/1.1" 201 0
2025-12-04 20:02:11 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0869b99e-218c-575f-9f79-5af58d9fe54c
2025-12-04 20:02:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0869b99e-218c-575f-9f79-5af58d9fe54c, skipping ID generation
2025-12-04 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 0869b99e-218c-575f-9f79-5af58d9fe54c
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_7.jpg not downloaded yet
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_1.jpg not downloaded yet
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_7.jpg not downloaded yet
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fad0b48d5-5f4d-497a-9526-c2fcc883d0da_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_5.jpg not downloaded yet
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_6.jpg not downloaded yet
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fad0b48d5-5f4d-497a-9526-c2fcc883d0da_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_4.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_1.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fad0b48d5-5f4d-497a-9526-c2fcc883d0da_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_11.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F456c4a73-6ce8-4bdd-8ada-36e2366fa80e_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_5.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fad0b48d5-5f4d-497a-9526-c2fcc883d0da_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_10.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F456c4a73-6ce8-4bdd-8ada-36e2366fa80e_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_4.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fad0b48d5-5f4d-497a-9526-c2fcc883d0da_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_9.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F456c4a73-6ce8-4bdd-8ada-36e2366fa80e_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_11.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_2.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F456c4a73-6ce8-4bdd-8ada-36e2366fa80e_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_10.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_5.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F456c4a73-6ce8-4bdd-8ada-36e2366fa80e_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_9.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_3.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_2.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_4.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_5.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1708581-4008007-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1708581-4008007-13.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_3.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1708581-4008007-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1708581-4008007-1000.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_4.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1708581-4008007-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1708581-4008007-1001.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1749068-3998620-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1749068-3998620-13.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1708581-4008007-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1708581-4008007-1002.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1749068-3998620-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1749068-3998620-1000.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1708581-4008007-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1708581-4008007-1003.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1749068-3998620-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1749068-3998620-1001.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1708581-4008007-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1708581-4008007-1004.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1749068-3998620-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1749068-3998620-1002.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1708581-4008007-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1708581-4008007-1005.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1749068-3998620-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1749068-3998620-1003.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1749068-3998620-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1749068-3998620-1004.jpg not downloaded yet
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1749068-3998620-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1749068-3998620-1005.jpg not downloaded yet
2025-12-04 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1708581-4008007-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001708581-01989056-002.pdf)
2025-12-04 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1749068-3998620-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001749068-01985488-002.pdf)
2025-12-04 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1749068-3998620-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001749068-01985488-002.pdf)
2025-12-04 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1749068-3998620-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001749068-01985488-002.pdf)
2025-12-04 20:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92270a50>
2025-12-04 20:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_19.jpg HTTP/1.1" 201 0
2025-12-04 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1708581-4008007-1005.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1708581-4008007-1005.jpg saved to cache
2025-12-04 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 81f9a3d9-99a9-5e0d-9d26-d52983783fdf
2025-12-04 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1708581-4008007-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001708581-01989056-002.pdf)
2025-12-04 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1708581-4008007-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001708581-01989056-002.pdf)
2025-12-04 20:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c923019d0>
2025-12-04 20:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_17.jpg HTTP/1.1" 201 0
2025-12-04 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1749068-3998620-1003.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1749068-3998620-1003.jpg saved to cache
2025-12-04 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 0869b99e-218c-575f-9f79-5af58d9fe54c
2025-12-04 20:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9235a1d0>
2025-12-04 20:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_19.jpg HTTP/1.1" 201 0
2025-12-04 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1749068-3998620-1005.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1749068-3998620-1005.jpg saved to cache
2025-12-04 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 0869b99e-218c-575f-9f79-5af58d9fe54c
2025-12-04 20:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9229c650>
2025-12-04 20:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_16.jpg HTTP/1.1" 201 0
2025-12-04 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1749068-3998620-1002.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1749068-3998620-1002.jpg saved to cache
2025-12-04 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 0869b99e-218c-575f-9f79-5af58d9fe54c
2025-12-04 20:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1708581-4008007-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001708581-01989056-002.pdf)
2025-12-04 20:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1708581-4008007-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001708581-01989056-002.pdf)
2025-12-04 20:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92396a10>
2025-12-04 20:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_17.jpg HTTP/1.1" 201 0
2025-12-04 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1708581-4008007-1003.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1708581-4008007-1003.jpg saved to cache
2025-12-04 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 81f9a3d9-99a9-5e0d-9d26-d52983783fdf
2025-12-04 20:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91b99b10>
2025-12-04 20:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_18.jpg HTTP/1.1" 201 0
2025-12-04 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1708581-4008007-1004.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1708581-4008007-1004.jpg saved to cache
2025-12-04 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 81f9a3d9-99a9-5e0d-9d26-d52983783fdf
2025-12-04 20:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1749068-3998620-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001749068-01985488-002.pdf)
2025-12-04 20:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1749068-3998620-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001749068-01985488-002.pdf)
2025-12-04 20:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/AUDI/A5?id=2274146&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232274146&indx=76> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 20:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1749068-3998620-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001749068-01985488-002.pdf)
2025-12-04 20:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1749068-3998620-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001749068-01985488-002.pdf)
2025-12-04 20:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001749068-01985488-002.pdf)
2025-12-04 20:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001749068-01985488-002.pdf)
2025-12-04 20:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91bb8f50>
2025-12-04 20:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_16.jpg HTTP/1.1" 201 0
2025-12-04 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1708581-4008007-1002.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1708581-4008007-1002.jpg saved to cache
2025-12-04 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 81f9a3d9-99a9-5e0d-9d26-d52983783fdf
2025-12-04 20:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92300850>
2025-12-04 20:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_15.jpg HTTP/1.1" 201 0
2025-12-04 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1708581-4008007-1001.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1708581-4008007-1001.jpg saved to cache
2025-12-04 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 81f9a3d9-99a9-5e0d-9d26-d52983783fdf
2025-12-04 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1708581-4008007-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001708581-01989056-002.pdf)
2025-12-04 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001749068-01985488-002.pdf)
2025-12-04 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001749068-01985488-002.pdf)
2025-12-04 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001708581-01989056-002.pdf)
2025-12-04 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1708581-4008007-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001708581-01989056-002.pdf)
2025-12-04 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001708581-01989056-002.pdf)
2025-12-04 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001749068-01985488-002.pdf)
2025-12-04 20:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92214450>
2025-12-04 20:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_15.jpg HTTP/1.1" 201 0
2025-12-04 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1749068-3998620-1001.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1749068-3998620-1001.jpg saved to cache
2025-12-04 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 0869b99e-218c-575f-9f79-5af58d9fe54c
2025-12-04 20:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c920dac10>
2025-12-04 20:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_14.jpg HTTP/1.1" 201 0
2025-12-04 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1749068-3998620-1000.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1749068-3998620-1000.jpg saved to cache
2025-12-04 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 0869b99e-218c-575f-9f79-5af58d9fe54c
2025-12-04 20:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27b7919c-0ec5-5f95-9e1f-79786329c12b with identifier: 2274146
2025-12-04 20:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27b7919c-0ec5-5f95-9e1f-79786329c12b with scrape type 2
2025-12-04 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27b7919c-0ec5-5f95-9e1f-79786329c12b with scrape type 2
2025-12-04 20:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 27b7919c-0ec5-5f95-9e1f-79786329c12b, identifier: 2274146
2025-12-04 20:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92359090>
2025-12-04 20:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_18.jpg HTTP/1.1" 201 0
2025-12-04 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1749068-3998620-1004.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1749068-3998620-1004.jpg saved to cache
2025-12-04 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 0869b99e-218c-575f-9f79-5af58d9fe54c
2025-12-04 20:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91aaf510>
2025-12-04 20:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_13.jpg HTTP/1.1" 201 0
2025-12-04 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1749068-3998620-13.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1749068-3998620-13.jpg saved to cache
2025-12-04 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 0869b99e-218c-575f-9f79-5af58d9fe54c
2025-12-04 20:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c921a1790>
2025-12-04 20:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_12.jpg HTTP/1.1" 201 0
2025-12-04 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_4.jpg saved to cache
2025-12-04 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 0869b99e-218c-575f-9f79-5af58d9fe54c
2025-12-04 20:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924b66d0>
2025-12-04 20:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_11.jpg HTTP/1.1" 201 0
2025-12-04 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_3.jpg saved to cache
2025-12-04 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 0869b99e-218c-575f-9f79-5af58d9fe54c
2025-12-04 20:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 27b7919c-0ec5-5f95-9e1f-79786329c12b with identifier: 2274146
2025-12-04 20:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 27b7919c-0ec5-5f95-9e1f-79786329c12b with identifier: 2274146
2025-12-04 20:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 27b7919c-0ec5-5f95-9e1f-79786329c12b with identifier: 2274146 to the API
2025-12-04 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 20:02:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 20:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/AUDI/A5?id=2274146&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232274146&indx=76>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002274146-01983017-005.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '27b7919c-0ec5-5f95-9e1f-79786329c12b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LR67LPP',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/A5?id=2274146',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'AUDI',
 'model': 'A5',
 'odometer': 70055,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-27',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'AUDI A5 2.0 TFSI S Line 2dr S Tronic',
 'transmission': 'automatic',
 'trim': '2.0 TFSI S Line 2dr S Tronic',
 'year': 2017}
2025-12-04 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272274146%27 HTTP/1.1" 200 None
2025-12-04 20:02:17 [manheim.gb] INFO: Saving data for 2274146: {'auction_closing_time': 1765270800.0, 'created_time': 1764583927.429641, 'last_price_update_time': 1764878537.479462}
2025-12-04 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2274146') HTTP/1.1" 204 0
2025-12-04 20:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/ASTRA?id=2216514&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232216514&indx=69> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 20:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001749068-01985488-002.pdf)
2025-12-04 20:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001749068-01985488-002.pdf)
2025-12-04 20:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001708581-01989056-002.pdf)
2025-12-04 20:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001708581-01989056-002.pdf)
2025-12-04 20:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001708581-01989056-002.pdf)
2025-12-04 20:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001749068-01985488-002.pdf)
2025-12-04 20:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001749068-01985488-002.pdf)
2025-12-04 20:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001708581-01989056-002.pdf)
2025-12-04 20:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c923ea450>
2025-12-04 20:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_14.jpg HTTP/1.1" 201 0
2025-12-04 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1708581-4008007-1000.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1708581-4008007-1000.jpg saved to cache
2025-12-04 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 81f9a3d9-99a9-5e0d-9d26-d52983783fdf
2025-12-04 20:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a86250>
2025-12-04 20:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_10.jpg HTTP/1.1" 201 0
2025-12-04 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_5.jpg saved to cache
2025-12-04 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 0869b99e-218c-575f-9f79-5af58d9fe54c
2025-12-04 20:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92286e10>
2025-12-04 20:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_8.jpg HTTP/1.1" 201 0
2025-12-04 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F456c4a73-6ce8-4bdd-8ada-36e2366fa80e_9.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_9.jpg saved to cache
2025-12-04 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0869b99e-218c-575f-9f79-5af58d9fe54c
2025-12-04 20:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a84750>
2025-12-04 20:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_12.jpg HTTP/1.1" 201 0
2025-12-04 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_4.jpg saved to cache
2025-12-04 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 81f9a3d9-99a9-5e0d-9d26-d52983783fdf
2025-12-04 20:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a860d0>
2025-12-04 20:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_13.jpg HTTP/1.1" 201 0
2025-12-04 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1708581-4008007-13.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1708581-4008007-13.jpg saved to cache
2025-12-04 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 81f9a3d9-99a9-5e0d-9d26-d52983783fdf
2025-12-04 20:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c922fa790>
2025-12-04 20:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_11.jpg HTTP/1.1" 201 0
2025-12-04 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_3.jpg saved to cache
2025-12-04 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 81f9a3d9-99a9-5e0d-9d26-d52983783fdf
2025-12-04 20:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9217e410>
2025-12-04 20:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_9.jpg HTTP/1.1" 201 0
2025-12-04 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_2.jpg saved to cache
2025-12-04 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0869b99e-218c-575f-9f79-5af58d9fe54c
2025-12-04 20:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001708581-01989056-002.pdf)
2025-12-04 20:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001708581-01989056-002.pdf)
2025-12-04 20:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001749068-01985488-002.pdf)
2025-12-04 20:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32c741c9-0956-5169-aca3-197f07605d36 with identifier: 2216514
2025-12-04 20:02:19 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 32c741c9-0956-5169-aca3-197f07605d36
2025-12-04 20:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924f92d0>
2025-12-04 20:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_7.jpg HTTP/1.1" 201 0
2025-12-04 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F456c4a73-6ce8-4bdd-8ada-36e2366fa80e_10.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_10.jpg saved to cache
2025-12-04 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0869b99e-218c-575f-9f79-5af58d9fe54c
2025-12-04 20:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9224e150>
2025-12-04 20:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_6.jpg HTTP/1.1" 201 0
2025-12-04 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F456c4a73-6ce8-4bdd-8ada-36e2366fa80e_11.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_11.jpg saved to cache
2025-12-04 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0869b99e-218c-575f-9f79-5af58d9fe54c
2025-12-04 20:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92438210>
2025-12-04 20:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_8.jpg HTTP/1.1" 201 0
2025-12-04 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fad0b48d5-5f4d-497a-9526-c2fcc883d0da_9.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_9.jpg saved to cache
2025-12-04 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 81f9a3d9-99a9-5e0d-9d26-d52983783fdf
2025-12-04 20:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92344110>
2025-12-04 20:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_10.jpg HTTP/1.1" 201 0
2025-12-04 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_5.jpg saved to cache
2025-12-04 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 81f9a3d9-99a9-5e0d-9d26-d52983783fdf
2025-12-04 20:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9243ae50>
2025-12-04 20:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_9.jpg HTTP/1.1" 201 0
2025-12-04 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_2.jpg saved to cache
2025-12-04 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 81f9a3d9-99a9-5e0d-9d26-d52983783fdf
2025-12-04 20:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924f9e10>
2025-12-04 20:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_5.jpg HTTP/1.1" 201 0
2025-12-04 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F456c4a73-6ce8-4bdd-8ada-36e2366fa80e_4.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_4.jpg saved to cache
2025-12-04 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0869b99e-218c-575f-9f79-5af58d9fe54c
2025-12-04 20:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92189990>
2025-12-04 20:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_4.jpg HTTP/1.1" 201 0
2025-12-04 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F456c4a73-6ce8-4bdd-8ada-36e2366fa80e_5.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_5.jpg saved to cache
2025-12-04 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0869b99e-218c-575f-9f79-5af58d9fe54c
2025-12-04 20:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9243bf90>
2025-12-04 20:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_7.jpg HTTP/1.1" 201 0
2025-12-04 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fad0b48d5-5f4d-497a-9526-c2fcc883d0da_10.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_10.jpg saved to cache
2025-12-04 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 81f9a3d9-99a9-5e0d-9d26-d52983783fdf
2025-12-04 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001749068-01985488-002.pdf)
2025-12-04 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001749068-01985488-002.pdf)
2025-12-04 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001708581-01989056-002.pdf)
2025-12-04 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001708581-01989056-002.pdf)
2025-12-04 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001708581-01989056-002.pdf)
2025-12-04 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001749068-01985488-002.pdf)
2025-12-04 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001708581-01989056-002.pdf)
2025-12-04 20:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9231ce90>
2025-12-04 20:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_6.jpg HTTP/1.1" 201 0
2025-12-04 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fad0b48d5-5f4d-497a-9526-c2fcc883d0da_11.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_11.jpg saved to cache
2025-12-04 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 81f9a3d9-99a9-5e0d-9d26-d52983783fdf
2025-12-04 20:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c922bd450>
2025-12-04 20:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_5.jpg HTTP/1.1" 201 0
2025-12-04 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fad0b48d5-5f4d-497a-9526-c2fcc883d0da_4.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_4.jpg saved to cache
2025-12-04 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 81f9a3d9-99a9-5e0d-9d26-d52983783fdf
2025-12-04 20:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c920c1790>
2025-12-04 20:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_3.jpg HTTP/1.1" 201 0
2025-12-04 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_1.jpg saved to cache
2025-12-04 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0869b99e-218c-575f-9f79-5af58d9fe54c
2025-12-04 20:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001708581-01989056-002.pdf)
2025-12-04 20:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002029104-01991886-002.pdf)
2025-12-04 20:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002029104-01991886-002.pdf)
2025-12-04 20:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9244ef50>
2025-12-04 20:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_0.jpg HTTP/1.1" 201 0
2025-12-04 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_7.jpg saved to cache
2025-12-04 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0869b99e-218c-575f-9f79-5af58d9fe54c
2025-12-04 20:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c923bafd0>
2025-12-04 20:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_1.jpg HTTP/1.1" 201 0
2025-12-04 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_7.jpg saved to cache
2025-12-04 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0869b99e-218c-575f-9f79-5af58d9fe54c
2025-12-04 20:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c923bb810>
2025-12-04 20:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_4.jpg HTTP/1.1" 201 0
2025-12-04 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fad0b48d5-5f4d-497a-9526-c2fcc883d0da_5.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_5.jpg saved to cache
2025-12-04 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 81f9a3d9-99a9-5e0d-9d26-d52983783fdf
2025-12-04 20:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9217da10>
2025-12-04 20:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_1.jpg HTTP/1.1" 201 0
2025-12-04 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_7.jpg saved to cache
2025-12-04 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 81f9a3d9-99a9-5e0d-9d26-d52983783fdf
2025-12-04 20:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c923b8f90>
2025-12-04 20:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_3.jpg HTTP/1.1" 201 0
2025-12-04 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_1.jpg saved to cache
2025-12-04 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 81f9a3d9-99a9-5e0d-9d26-d52983783fdf
2025-12-04 20:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a5bf50>
2025-12-04 20:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_2.jpg HTTP/1.1" 201 0
2025-12-04 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_6.jpg saved to cache
2025-12-04 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0869b99e-218c-575f-9f79-5af58d9fe54c
2025-12-04 20:02:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0869b99e-218c-575f-9f79-5af58d9fe54c, skipping ID generation
2025-12-04 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0869b99e-218c-575f-9f79-5af58d9fe54c from tracking dictionaries
2025-12-04 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0869b99e-218c-575f-9f79-5af58d9fe54c sending to next pipeline
2025-12-04 20:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 0869b99e-218c-575f-9f79-5af58d9fe54c, identifier: 1749068
2025-12-04 20:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9231d210>
2025-12-04 20:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_2.jpg HTTP/1.1" 201 0
2025-12-04 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_6.jpg saved to cache
2025-12-04 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 81f9a3d9-99a9-5e0d-9d26-d52983783fdf
2025-12-04 20:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002029104-01991886-002.pdf)
2025-12-04 20:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002029104-01991886-002.pdf)
2025-12-04 20:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 0869b99e-218c-575f-9f79-5af58d9fe54c with identifier: 1749068
2025-12-04 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 20:02:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=RED HTTP/1.1" 200 None
2025-12-04 20:02:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 20:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 0869b99e-218c-575f-9f79-5af58d9fe54c with identifier: 1749068
2025-12-04 20:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 0869b99e-218c-575f-9f79-5af58d9fe54c with identifier: 1749068 to the API
2025-12-04 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 20:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 20:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_expert_report_file_e8b7c497-491d-423f-bf9e-0b1b74cd4174.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001749068-01985488-002.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0869b99e-218c-575f-9f79-5af58d9fe54c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LG67PFD',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C3?id=1749068',
 'listing': 'auction',
 'location': 'Manchester',
 'make': 'CITROEN',
 'model': 'C3',
 'odometer': 39883,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 44,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176470,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176470,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213146,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228135,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 175870,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 181529,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 177347,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 179026,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 181256,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205375,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 168001,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239313,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 155911,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/456c4a73-6ce8-4bdd-8ada-36e2366fa80e_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 487403,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1749068-3998620-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 415989,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1749068-3998620-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294978,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1749068-3998620-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256404,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1749068-3998620-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247985,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1749068-3998620-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591470,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1749068-3998620-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0869b99e-218c-575f-9f79-5af58d9fe54c/0869b99e-218c-575f-9f79-5af58d9fe54c_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363112,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1749068-3998620-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-30',
 'seller_name': 'MotoNovo Finance',
 'title': 'CITROEN C3 1.2 PureTech 82 Flair 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 82 Flair 5dr',
 'year': 2017}
2025-12-04 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271749068%27 HTTP/1.1" 200 None
2025-12-04 20:02:25 [manheim.gb] INFO: Saving data for 1749068: {'created_time': 1764878545.310877, 'last_price_update_time': 1764878545.310886, 'auction_closing_time': 1765270800.0}
2025-12-04 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1749068') HTTP/1.1" 204 0
2025-12-04 20:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002029104-01991886-002.pdf)
2025-12-04 20:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002029104-01991886-002.pdf)
2025-12-04 20:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92194150>
2025-12-04 20:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_0.jpg HTTP/1.1" 201 0
2025-12-04 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_7.jpg saved to cache
2025-12-04 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 81f9a3d9-99a9-5e0d-9d26-d52983783fdf
2025-12-04 20:02:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 81f9a3d9-99a9-5e0d-9d26-d52983783fdf, skipping ID generation
2025-12-04 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 81f9a3d9-99a9-5e0d-9d26-d52983783fdf from tracking dictionaries
2025-12-04 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 81f9a3d9-99a9-5e0d-9d26-d52983783fdf sending to next pipeline
2025-12-04 20:02:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 81f9a3d9-99a9-5e0d-9d26-d52983783fdf, identifier: 1708581
2025-12-04 20:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92385610>
2025-12-04 20:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_18.jpg HTTP/1.1" 201 0
2025-12-04 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2029104-4008237-1004.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1004.jpg saved to cache
2025-12-04 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item cf5328e4-df40-5970-8131-df34e67a1910
2025-12-04 20:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9231c550>
2025-12-04 20:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_15.jpg HTTP/1.1" 201 0
2025-12-04 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2029104-4008237-1001.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1001.jpg saved to cache
2025-12-04 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item cf5328e4-df40-5970-8131-df34e67a1910
2025-12-04 20:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924ba1d0>
2025-12-04 20:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_17.jpg HTTP/1.1" 201 0
2025-12-04 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2029104-4008237-1003.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1003.jpg saved to cache
2025-12-04 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item cf5328e4-df40-5970-8131-df34e67a1910
2025-12-04 20:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92232d50>
2025-12-04 20:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_19.jpg HTTP/1.1" 201 0
2025-12-04 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2029104-4008237-1005.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1005.jpg saved to cache
2025-12-04 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item cf5328e4-df40-5970-8131-df34e67a1910
2025-12-04 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1678661-4007948-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001678661-01992754-003.pdf)
2025-12-04 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002029104-01991886-002.pdf)
2025-12-04 20:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 81f9a3d9-99a9-5e0d-9d26-d52983783fdf with identifier: 1708581
2025-12-04 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 20:02:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Red HTTP/1.1" 200 None
2025-12-04 20:02:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 20:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 81f9a3d9-99a9-5e0d-9d26-d52983783fdf with identifier: 1708581
2025-12-04 20:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-04 20:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 81f9a3d9-99a9-5e0d-9d26-d52983783fdf spider: manheim.gb
2025-12-04 20:02:27 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 81f9a3d9-99a9-5e0d-9d26-d52983783fdf due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_expert_report_file_380a71d7-2458-477b-be27-e8be487fd1ce.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001708581-01989056-002.pdf',
 'color': 'Red',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-11T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '81f9a3d9-99a9-5e0d-9d26-d52983783fdf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'NX15JYH',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=1708581',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 91124,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 45,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 167383,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 167383,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255044,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 136543,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 159740,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 154583,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 160636,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 158717,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 167159,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234186,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222278,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218458,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192172,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ad0b48d5-5f4d-497a-9526-c2fcc883d0da_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244785,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1708581-4008007-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306863,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1708581-4008007-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213877,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1708581-4008007-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 183521,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1708581-4008007-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222743,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1708581-4008007-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231322,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1708581-4008007-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81f9a3d9-99a9-5e0d-9d26-d52983783fdf/81f9a3d9-99a9-5e0d-9d26-d52983783fdf_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223886,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1708581-4008007-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-02',
 'seller_name': 'Thurlow Nunn',
 'title': 'FORD FOCUS 1.6 TDCi 115 Zetec 5dr',
 'transmission': 'manual',
 'trim': '1.6 TDCi 115 Zetec 5dr',
 'year': 2015}
2025-12-04 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271708581%27 HTTP/1.1" 200 None
2025-12-04 20:02:27 [manheim.gb] INFO: Saving data for 1708581: {'created_time': 1764878547.082265, 'last_price_update_time': 1764878547.082275, 'auction_closing_time': 1765443600.0}
2025-12-04 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1708581') HTTP/1.1" 204 0
2025-12-04 20:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002029104-01991886-002.pdf)
2025-12-04 20:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1678661-4007948-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001678661-01992754-003.pdf)
2025-12-04 20:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002029104-01991886-002.pdf)
2025-12-04 20:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002029104-01991886-002.pdf)
2025-12-04 20:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92397690>
2025-12-04 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_16.jpg HTTP/1.1" 201 0
2025-12-04 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2029104-4008237-1002.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1002.jpg saved to cache
2025-12-04 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item cf5328e4-df40-5970-8131-df34e67a1910
2025-12-04 20:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c923de610>
2025-12-04 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_14.jpg HTTP/1.1" 201 0
2025-12-04 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2029104-4008237-1000.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1000.jpg saved to cache
2025-12-04 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item cf5328e4-df40-5970-8131-df34e67a1910
2025-12-04 20:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9217da50>
2025-12-04 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_19.jpg HTTP/1.1" 201 0
2025-12-04 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1678661-4007948-1005.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1678661-4007948-1005.jpg saved to cache
2025-12-04 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item d1a58caf-7dc1-5f72-802d-96a885429506
2025-12-04 20:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a926d0>
2025-12-04 20:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_13.jpg HTTP/1.1" 201 0
2025-12-04 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2029104-4008237-13.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-13.jpg saved to cache
2025-12-04 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item cf5328e4-df40-5970-8131-df34e67a1910
2025-12-04 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1678661-4007948-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001678661-01992754-003.pdf)
2025-12-04 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1678661-4007948-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001678661-01992754-003.pdf)
2025-12-04 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002029104-01991886-002.pdf)
2025-12-04 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002029104-01991886-002.pdf)
2025-12-04 20:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c921a0610>
2025-12-04 20:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_12.jpg HTTP/1.1" 201 0
2025-12-04 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_4.jpg saved to cache
2025-12-04 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item cf5328e4-df40-5970-8131-df34e67a1910
2025-12-04 20:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a87790>
2025-12-04 20:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_18.jpg HTTP/1.1" 201 0
2025-12-04 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1678661-4007948-1004.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1678661-4007948-1004.jpg saved to cache
2025-12-04 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item d1a58caf-7dc1-5f72-802d-96a885429506
2025-12-04 20:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9213fe10>
2025-12-04 20:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_11.jpg HTTP/1.1" 201 0
2025-12-04 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_3.jpg saved to cache
2025-12-04 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item cf5328e4-df40-5970-8131-df34e67a1910
2025-12-04 20:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c923150d0>
2025-12-04 20:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_10.jpg HTTP/1.1" 201 0
2025-12-04 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_5.jpg saved to cache
2025-12-04 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item cf5328e4-df40-5970-8131-df34e67a1910
2025-12-04 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1678661-4007948-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001678661-01992754-003.pdf)
2025-12-04 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1678661-4007948-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001678661-01992754-003.pdf)
2025-12-04 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002029104-01991886-002.pdf)
2025-12-04 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001678661-01992754-003.pdf)
2025-12-04 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002029104-01991886-002.pdf)
2025-12-04 20:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c923dc590>
2025-12-04 20:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_17.jpg HTTP/1.1" 201 0
2025-12-04 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1678661-4007948-1003.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1678661-4007948-1003.jpg saved to cache
2025-12-04 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item d1a58caf-7dc1-5f72-802d-96a885429506
2025-12-04 20:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c923d4a10>
2025-12-04 20:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_16.jpg HTTP/1.1" 201 0
2025-12-04 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1678661-4007948-1002.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1678661-4007948-1002.jpg saved to cache
2025-12-04 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item d1a58caf-7dc1-5f72-802d-96a885429506
2025-12-04 20:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a67e50>
2025-12-04 20:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_8.jpg HTTP/1.1" 201 0
2025-12-04 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F606c4bfb-48f3-4379-9fa3-8f0fe501d175_9.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_9.jpg saved to cache
2025-12-04 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cf5328e4-df40-5970-8131-df34e67a1910
2025-12-04 20:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c923159d0>
2025-12-04 20:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_9.jpg HTTP/1.1" 201 0
2025-12-04 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_2.jpg saved to cache
2025-12-04 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cf5328e4-df40-5970-8131-df34e67a1910
2025-12-04 20:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1678661-4007948-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001678661-01992754-003.pdf)
2025-12-04 20:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002029104-01991886-002.pdf)
2025-12-04 20:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002029104-01991886-002.pdf)
2025-12-04 20:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001678661-01992754-003.pdf)
2025-12-04 20:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001678661-01992754-003.pdf)
2025-12-04 20:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002029104-01991886-002.pdf)
2025-12-04 20:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001678661-01992754-003.pdf)
2025-12-04 20:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c920607d0>
2025-12-04 20:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_14.jpg HTTP/1.1" 201 0
2025-12-04 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1678661-4007948-1000.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1678661-4007948-1000.jpg saved to cache
2025-12-04 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item d1a58caf-7dc1-5f72-802d-96a885429506
2025-12-04 20:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924bb9d0>
2025-12-04 20:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_15.jpg HTTP/1.1" 201 0
2025-12-04 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1678661-4007948-1001.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1678661-4007948-1001.jpg saved to cache
2025-12-04 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item d1a58caf-7dc1-5f72-802d-96a885429506
2025-12-04 20:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924b0ad0>
2025-12-04 20:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_6.jpg HTTP/1.1" 201 0
2025-12-04 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F606c4bfb-48f3-4379-9fa3-8f0fe501d175_11.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_11.jpg saved to cache
2025-12-04 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf5328e4-df40-5970-8131-df34e67a1910
2025-12-04 20:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c923ba8d0>
2025-12-04 20:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_12.jpg HTTP/1.1" 201 0
2025-12-04 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F628d0664-2e16-4b91-b71f-632d0590280f_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_4.jpg saved to cache
2025-12-04 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item d1a58caf-7dc1-5f72-802d-96a885429506
2025-12-04 20:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924b1ad0>
2025-12-04 20:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_7.jpg HTTP/1.1" 201 0
2025-12-04 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F606c4bfb-48f3-4379-9fa3-8f0fe501d175_10.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_10.jpg saved to cache
2025-12-04 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cf5328e4-df40-5970-8131-df34e67a1910
2025-12-04 20:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001678661-01992754-003.pdf)
2025-12-04 20:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c923026d0>
2025-12-04 20:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_13.jpg HTTP/1.1" 201 0
2025-12-04 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1678661-4007948-13.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1678661-4007948-13.jpg saved to cache
2025-12-04 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item d1a58caf-7dc1-5f72-802d-96a885429506
2025-12-04 20:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c93920350>
2025-12-04 20:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_5.jpg HTTP/1.1" 201 0
2025-12-04 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F606c4bfb-48f3-4379-9fa3-8f0fe501d175_4.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_4.jpg saved to cache
2025-12-04 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf5328e4-df40-5970-8131-df34e67a1910
2025-12-04 20:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92363cd0>
2025-12-04 20:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_4.jpg HTTP/1.1" 201 0
2025-12-04 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F606c4bfb-48f3-4379-9fa3-8f0fe501d175_5.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_5.jpg saved to cache
2025-12-04 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf5328e4-df40-5970-8131-df34e67a1910
2025-12-04 20:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92214310>
2025-12-04 20:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_11.jpg HTTP/1.1" 201 0
2025-12-04 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F628d0664-2e16-4b91-b71f-632d0590280f_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_3.jpg saved to cache
2025-12-04 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item d1a58caf-7dc1-5f72-802d-96a885429506
2025-12-04 20:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a97e50>
2025-12-04 20:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_8.jpg HTTP/1.1" 201 0
2025-12-04 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F628d0664-2e16-4b91-b71f-632d0590280f_9.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_9.jpg saved to cache
2025-12-04 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d1a58caf-7dc1-5f72-802d-96a885429506
2025-12-04 20:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91ba2490>
2025-12-04 20:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_3.jpg HTTP/1.1" 201 0
2025-12-04 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_1.jpg saved to cache
2025-12-04 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf5328e4-df40-5970-8131-df34e67a1910
2025-12-04 20:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c921c0b90>
2025-12-04 20:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_10.jpg HTTP/1.1" 201 0
2025-12-04 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F628d0664-2e16-4b91-b71f-632d0590280f_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_5.jpg saved to cache
2025-12-04 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item d1a58caf-7dc1-5f72-802d-96a885429506
2025-12-04 20:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001678661-01992754-003.pdf)
2025-12-04 20:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002029104-01991886-002.pdf)
2025-12-04 20:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9218aa90>
2025-12-04 20:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_9.jpg HTTP/1.1" 201 0
2025-12-04 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F628d0664-2e16-4b91-b71f-632d0590280f_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_2.jpg saved to cache
2025-12-04 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d1a58caf-7dc1-5f72-802d-96a885429506
2025-12-04 20:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001678661-01992754-003.pdf)
2025-12-04 20:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001678661-01992754-003.pdf)
2025-12-04 20:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001678661-01992754-003.pdf)
2025-12-04 20:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001678661-01992754-003.pdf)
2025-12-04 20:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002029104-01991886-002.pdf)
2025-12-04 20:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002029104-01991886-002.pdf)
2025-12-04 20:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001678661-01992754-003.pdf)
2025-12-04 20:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924d9dd0>
2025-12-04 20:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_7.jpg HTTP/1.1" 201 0
2025-12-04 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F628d0664-2e16-4b91-b71f-632d0590280f_10.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_10.jpg saved to cache
2025-12-04 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d1a58caf-7dc1-5f72-802d-96a885429506
2025-12-04 20:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91b9c810>
2025-12-04 20:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_2.jpg HTTP/1.1" 201 0
2025-12-04 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_6.jpg saved to cache
2025-12-04 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf5328e4-df40-5970-8131-df34e67a1910
2025-12-04 20:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001678661-01992754-003.pdf)
2025-12-04 20:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92118610>
2025-12-04 20:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_3.jpg HTTP/1.1" 201 0
2025-12-04 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F628d0664-2e16-4b91-b71f-632d0590280f_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_1.jpg saved to cache
2025-12-04 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d1a58caf-7dc1-5f72-802d-96a885429506
2025-12-04 20:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9240b990>
2025-12-04 20:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_6.jpg HTTP/1.1" 201 0
2025-12-04 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F628d0664-2e16-4b91-b71f-632d0590280f_11.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_11.jpg saved to cache
2025-12-04 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d1a58caf-7dc1-5f72-802d-96a885429506
2025-12-04 20:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92286b90>
2025-12-04 20:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_5.jpg HTTP/1.1" 201 0
2025-12-04 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F628d0664-2e16-4b91-b71f-632d0590280f_4.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_4.jpg saved to cache
2025-12-04 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d1a58caf-7dc1-5f72-802d-96a885429506
2025-12-04 20:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924ba150>
2025-12-04 20:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_4.jpg HTTP/1.1" 201 0
2025-12-04 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F628d0664-2e16-4b91-b71f-632d0590280f_5.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_5.jpg saved to cache
2025-12-04 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d1a58caf-7dc1-5f72-802d-96a885429506
2025-12-04 20:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a65710>
2025-12-04 20:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_0.jpg HTTP/1.1" 201 0
2025-12-04 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_7.jpg saved to cache
2025-12-04 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf5328e4-df40-5970-8131-df34e67a1910
2025-12-04 20:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c920a79d0>
2025-12-04 20:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_1.jpg HTTP/1.1" 201 0
2025-12-04 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_7.jpg saved to cache
2025-12-04 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf5328e4-df40-5970-8131-df34e67a1910
2025-12-04 20:02:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf5328e4-df40-5970-8131-df34e67a1910, skipping ID generation
2025-12-04 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cf5328e4-df40-5970-8131-df34e67a1910 from tracking dictionaries
2025-12-04 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf5328e4-df40-5970-8131-df34e67a1910 sending to next pipeline
2025-12-04 20:02:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: cf5328e4-df40-5970-8131-df34e67a1910, identifier: 2029104
2025-12-04 20:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c921a8f10>
2025-12-04 20:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_1.jpg HTTP/1.1" 201 0
2025-12-04 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F628d0664-2e16-4b91-b71f-632d0590280f_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_7.jpg saved to cache
2025-12-04 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d1a58caf-7dc1-5f72-802d-96a885429506
2025-12-04 20:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: cf5328e4-df40-5970-8131-df34e67a1910 with identifier: 2029104
2025-12-04 20:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 20:02:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Silver HTTP/1.1" 200 None
2025-12-04 20:02:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 20:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: cf5328e4-df40-5970-8131-df34e67a1910 with identifier: 2029104
2025-12-04 20:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 28, 'seller_name': 'big motoring world ltd', 'price_includes_vat': False, 'title': 'vauxhall corsa 1.2i 16v sxi 3dr [ac]', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'corsa', 'transmission': 'manual', 'engine': '1.2l', 'fuel_type': 'petrol', 'odometer': 129232, 'odometer_reading_unit': 'mi', 'registration_date': '2008-06-18', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/corsa?id=2029104', 'location': 'colchester', 'origin_country_code': 'gb', 'trim': '1.2i 16v sxi 3dr [ac]', 'license_plate': 'ds08kze', 'year': 2008, 'listing': 'auction', 'c_o_2_emission_value': 146, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002029104-01991886-002.pdf', 'expiration_date': '2025-12-11t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': 'cf5328e4-df40-5970-8131-df34e67a1910', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_expert_report_file_de90fb9a-923c-42de-9a65-1060eafe26ee.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 211002}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 211002}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 245704}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 205120}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 203674}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 191187}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 193374}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 188518}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 198489}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 256366}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 187124}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 196332}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 282729}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 280390}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 224372}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 231425}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 329329}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 301065}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 240649}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 271102}], 'current_year_diff': 17, 'age_in_months': 209, 'make_model': 'vauxhall corsa', 'sanitized_make': 'vauxhall', 'odometer_in_km': 207978}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 209,
     'auction_title': '',
     'c_o_2_emission_value': 146,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_expert_report_file_de90fb9a-923c-42de-9a65-1060eafe26ee.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002029104-01991886-002.pdf',
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 17,
     'engine': '1.2l',
     'expiration_date': '2025-12-11t09:00:00z',
     'fuel_type': 'petrol',
     'id': 'cf5328e4-df40-5970-8131-df34e67a1910',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'ds08kze',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/corsa?id=2029104',
     'listing': 'auction',
     'location': 'colchester',
     'make': 'vauxhall',
     'make_model': 'vauxhall corsa',
     'model': 'corsa',
     'odometer': 129232,
     'odometer_in_km': 207978,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 28,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 211002,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 211002,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 245704,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 205120,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 203674,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 191187,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 193374,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_11.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 188518,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_10.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 198489,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_9.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 256366,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 187124,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 196332,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 282729,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 280390,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-13.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 224372,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1000.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 231425,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 329329,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1002.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 301065,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1003.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 240649,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1004.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 271102,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1005.jpg',
                 'Width': 1333}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2008-06-18',
     'sanitized_make': 'vauxhall',
     'seller_name': 'big motoring world ltd',
     'title': 'vauxhall corsa 1.2i 16v sxi 3dr [ac]',
     'transmission': 'manual',
     'trim': '1.2i 16v sxi 3dr [ac]',
     'year': 2008}
2025-12-04 20:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: cf5328e4-df40-5970-8131-df34e67a1910 spider: manheim.gb
2025-12-04 20:02:38 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: cf5328e4-df40-5970-8131-df34e67a1910 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 28, 'seller_name': 'big motoring world ltd', 'price_includes_vat': False, 'title': 'vauxhall corsa 1.2i 16v sxi 3dr [ac]', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'corsa', 'transmission': 'manual', 'engine': '1.2l', 'fuel_type': 'petrol', 'odometer': 129232, 'odometer_reading_unit': 'mi', 'registration_date': '2008-06-18', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/corsa?id=2029104', 'location': 'colchester', 'origin_country_code': 'gb', 'trim': '1.2i 16v sxi 3dr [ac]', 'license_plate': 'ds08kze', 'year': 2008, 'listing': 'auction', 'c_o_2_emission_value': 146, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002029104-01991886-002.pdf', 'expiration_date': '2025-12-11t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': 'cf5328e4-df40-5970-8131-df34e67a1910', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_expert_report_file_de90fb9a-923c-42de-9a65-1060eafe26ee.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 211002}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 211002}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 245704}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 205120}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 203674}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 191187}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 193374}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 188518}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 198489}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 256366}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 187124}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 196332}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 282729}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 280390}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 224372}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 231425}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 329329}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 301065}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 240649}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 271102}], 'current_year_diff': 17, 'age_in_months': 209, 'make_model': 'vauxhall corsa', 'sanitized_make': 'vauxhall', 'odometer_in_km': 207978}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 209,
     'auction_title': '',
     'c_o_2_emission_value': 146,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_expert_report_file_de90fb9a-923c-42de-9a65-1060eafe26ee.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002029104-01991886-002.pdf',
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 17,
     'engine': '1.2l',
     'expiration_date': '2025-12-11t09:00:00z',
     'fuel_type': 'petrol',
     'id': 'cf5328e4-df40-5970-8131-df34e67a1910',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'ds08kze',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/corsa?id=2029104',
     'listing': 'auction',
     'location': 'colchester',
     'make': 'vauxhall',
     'make_model': 'vauxhall corsa',
     'model': 'corsa',
     'odometer': 129232,
     'odometer_in_km': 207978,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 28,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 211002,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 211002,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 245704,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 205120,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 203674,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 191187,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 193374,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_11.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 188518,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_10.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 198489,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_9.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 256366,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 187124,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 196332,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 282729,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 280390,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-13.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 224372,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1000.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 231425,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 329329,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1002.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 301065,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1003.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 240649,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1004.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 271102,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1005.jpg',
                 'Width': 1333}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2008-06-18',
     'sanitized_make': 'vauxhall',
     'seller_name': 'big motoring world ltd',
     'title': 'vauxhall corsa 1.2i 16v sxi 3dr [ac]',
     'transmission': 'manual',
     'trim': '1.2i 16v sxi 3dr [ac]',
     'year': 2008}
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_expert_report_file_de90fb9a-923c-42de-9a65-1060eafe26ee.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002029104-01991886-002.pdf',
 'color': 'Silver',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-11T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'cf5328e4-df40-5970-8131-df34e67a1910',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'DS08KZE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=2029104',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'VAUXHALL',
 'model': 'CORSA',
 'odometer': 129232,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 28,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211002,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211002,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245704,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205120,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203674,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191187,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193374,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 188518,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198489,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256366,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187124,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196332,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282729,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/606c4bfb-48f3-4379-9fa3-8f0fe501d175_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280390,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224372,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231425,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329329,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301065,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240649,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5328e4-df40-5970-8131-df34e67a1910/cf5328e4-df40-5970-8131-df34e67a1910_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271102,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2029104-4008237-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-18',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'VAUXHALL CORSA 1.2i 16V SXi 3dr [AC]',
 'transmission': 'manual',
 'trim': '1.2i 16V SXi 3dr [AC]',
 'year': 2008}
2025-12-04 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272029104%27 HTTP/1.1" 200 None
2025-12-04 20:02:38 [manheim.gb] INFO: Saving data for 2029104: {'created_time': 1764878558.034369, 'last_price_update_time': 1764878558.034378, 'auction_closing_time': 1765443600.0}
2025-12-04 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2029104') HTTP/1.1" 204 0
2025-12-04 20:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9247f950>
2025-12-04 20:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_2.jpg HTTP/1.1" 201 0
2025-12-04 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F628d0664-2e16-4b91-b71f-632d0590280f_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_6.jpg saved to cache
2025-12-04 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d1a58caf-7dc1-5f72-802d-96a885429506
2025-12-04 20:02:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1a58caf-7dc1-5f72-802d-96a885429506, skipping ID generation
2025-12-04 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d1a58caf-7dc1-5f72-802d-96a885429506 from tracking dictionaries
2025-12-04 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1a58caf-7dc1-5f72-802d-96a885429506 sending to next pipeline
2025-12-04 20:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: d1a58caf-7dc1-5f72-802d-96a885429506, identifier: 1678661
2025-12-04 20:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: d1a58caf-7dc1-5f72-802d-96a885429506 with identifier: 1678661
2025-12-04 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 20:02:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Black HTTP/1.1" 200 None
2025-12-04 20:02:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 20:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: d1a58caf-7dc1-5f72-802d-96a885429506 with identifier: 1678661
2025-12-04 20:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 134124 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    134124
2025-12-04 20:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: d1a58caf-7dc1-5f72-802d-96a885429506 spider: manheim.gb
2025-12-04 20:02:38 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: d1a58caf-7dc1-5f72-802d-96a885429506 due to rule: high_mileage_for_make.json, error: 134124 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    134124
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_expert_report_file_cef54bd7-669d-4f7c-a660-76c3561e76b2.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001678661-01992754-003.pdf',
 'color': 'Black',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'd1a58caf-7dc1-5f72-802d-96a885429506',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'AK67YVY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=1678661',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 83341,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 34,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217106,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217106,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281684,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193420,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 212574,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206153,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202042,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194180,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211954,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282759,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253763,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251002,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 174032,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/628d0664-2e16-4b91-b71f-632d0590280f_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 405447,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1678661-4007948-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312785,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1678661-4007948-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296943,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1678661-4007948-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282105,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1678661-4007948-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302875,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1678661-4007948-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 386876,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1678661-4007948-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a58caf-7dc1-5f72-802d-96a885429506/d1a58caf-7dc1-5f72-802d-96a885429506_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291389,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1678661-4007948-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-06',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'PEUGEOT 3008 1.2 Puretech Allure 5dr EAT6',
 'transmission': 'automatic',
 'trim': '1.2 Puretech Allure 5dr EAT6',
 'year': 2018}
2025-12-04 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271678661%27 HTTP/1.1" 200 None
2025-12-04 20:02:38 [manheim.gb] INFO: Saving data for 1678661: {'created_time': 1764878558.865965, 'last_price_update_time': 1764878558.865975, 'auction_closing_time': 1765270800.0}
2025-12-04 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1678661') HTTP/1.1" 204 0
2025-12-04 20:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002216514-01992292-001.pdf> (referer: None)
2025-12-04 20:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a793d0>
2025-12-04 20:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_expert_report_file_a7bd2619-d858-421f-8e05-769c0f37cf31.pdf HTTP/1.1" 201 0
2025-12-04 20:02:39 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 32c741c9-0956-5169-aca3-197f07605d36
2025-12-04 20:02:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 32c741c9-0956-5169-aca3-197f07605d36, skipping ID generation
2025-12-04 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 32c741c9-0956-5169-aca3-197f07605d36
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe0dbb812-5543-4640-89f1-765e2ce686e4_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_7.jpg not downloaded yet
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe0dbb812-5543-4640-89f1-765e2ce686e4_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_7.jpg not downloaded yet
2025-12-04 20:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/CLA?id=2171364&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232171364&indx=65> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe0dbb812-5543-4640-89f1-765e2ce686e4_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_6.jpg not downloaded yet
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe0dbb812-5543-4640-89f1-765e2ce686e4_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_1.jpg not downloaded yet
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe0dbb812-5543-4640-89f1-765e2ce686e4_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_5.jpg not downloaded yet
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe0dbb812-5543-4640-89f1-765e2ce686e4_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_4.jpg not downloaded yet
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe0dbb812-5543-4640-89f1-765e2ce686e4_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_11.jpg not downloaded yet
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe0dbb812-5543-4640-89f1-765e2ce686e4_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_10.jpg not downloaded yet
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe0dbb812-5543-4640-89f1-765e2ce686e4_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_9.jpg not downloaded yet
2025-12-04 20:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9898389f-0af9-5e3f-9710-9e3dace200a3 with identifier: 2171364
2025-12-04 20:02:39 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9898389f-0af9-5e3f-9710-9e3dace200a3
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe0dbb812-5543-4640-89f1-765e2ce686e4_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_2.jpg not downloaded yet
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe0dbb812-5543-4640-89f1-765e2ce686e4_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_5.jpg not downloaded yet
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe0dbb812-5543-4640-89f1-765e2ce686e4_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_3.jpg not downloaded yet
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe0dbb812-5543-4640-89f1-765e2ce686e4_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_4.jpg not downloaded yet
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2216514-4008410-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2216514-4008410-13.jpg not downloaded yet
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2216514-4008410-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2216514-4008410-1000.jpg not downloaded yet
2025-12-04 20:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002216514-01992292-001.pdf)
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2216514-4008410-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2216514-4008410-1001.jpg not downloaded yet
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2216514-4008410-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2216514-4008410-1002.jpg not downloaded yet
2025-12-04 20:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002216514-01992292-001.pdf)
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2216514-4008410-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2216514-4008410-1003.jpg not downloaded yet
2025-12-04 20:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002216514-01992292-001.pdf)
2025-12-04 20:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002216514-01992292-001.pdf)
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2216514-4008410-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2216514-4008410-1004.jpg not downloaded yet
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2216514-4008410-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2216514-4008410-1005.jpg not downloaded yet
2025-12-04 20:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92439ad0>
2025-12-04 20:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_0.jpg HTTP/1.1" 201 0
2025-12-04 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe0dbb812-5543-4640-89f1-765e2ce686e4_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_7.jpg saved to cache
2025-12-04 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 32c741c9-0956-5169-aca3-197f07605d36
2025-12-04 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002216514-01992292-001.pdf)
2025-12-04 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002216514-01992292-001.pdf)
2025-12-04 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002216514-01992292-001.pdf)
2025-12-04 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002216514-01992292-001.pdf)
2025-12-04 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002216514-01992292-001.pdf)
2025-12-04 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002216514-01992292-001.pdf)
2025-12-04 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002216514-01992292-001.pdf)
2025-12-04 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002216514-01992292-001.pdf)
2025-12-04 20:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9224e690>
2025-12-04 20:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_2.jpg HTTP/1.1" 201 0
2025-12-04 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe0dbb812-5543-4640-89f1-765e2ce686e4_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_6.jpg saved to cache
2025-12-04 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 32c741c9-0956-5169-aca3-197f07605d36
2025-12-04 20:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92045dd0>
2025-12-04 20:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_3.jpg HTTP/1.1" 201 0
2025-12-04 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe0dbb812-5543-4640-89f1-765e2ce686e4_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_1.jpg saved to cache
2025-12-04 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 32c741c9-0956-5169-aca3-197f07605d36
2025-12-04 20:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a72c10>
2025-12-04 20:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_1.jpg HTTP/1.1" 201 0
2025-12-04 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe0dbb812-5543-4640-89f1-765e2ce686e4_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_7.jpg saved to cache
2025-12-04 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 32c741c9-0956-5169-aca3-197f07605d36
2025-12-04 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2216514-4008410-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002216514-01992292-001.pdf)
2025-12-04 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002216514-01992292-001.pdf)
2025-12-04 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2216514-4008410-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002216514-01992292-001.pdf)
2025-12-04 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2216514-4008410-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002216514-01992292-001.pdf)
2025-12-04 20:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9223c410>
2025-12-04 20:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_5.jpg HTTP/1.1" 201 0
2025-12-04 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe0dbb812-5543-4640-89f1-765e2ce686e4_4.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_4.jpg saved to cache
2025-12-04 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 32c741c9-0956-5169-aca3-197f07605d36
2025-12-04 20:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c921cc950>
2025-12-04 20:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_4.jpg HTTP/1.1" 201 0
2025-12-04 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe0dbb812-5543-4640-89f1-765e2ce686e4_5.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_5.jpg saved to cache
2025-12-04 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 32c741c9-0956-5169-aca3-197f07605d36
2025-12-04 20:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9223e510>
2025-12-04 20:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_6.jpg HTTP/1.1" 201 0
2025-12-04 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe0dbb812-5543-4640-89f1-765e2ce686e4_11.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_11.jpg saved to cache
2025-12-04 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 32c741c9-0956-5169-aca3-197f07605d36
2025-12-04 20:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a67910>
2025-12-04 20:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_10.jpg HTTP/1.1" 201 0
2025-12-04 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe0dbb812-5543-4640-89f1-765e2ce686e4_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_5.jpg saved to cache
2025-12-04 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 32c741c9-0956-5169-aca3-197f07605d36
2025-12-04 20:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c921ceb10>
2025-12-04 20:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_9.jpg HTTP/1.1" 201 0
2025-12-04 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe0dbb812-5543-4640-89f1-765e2ce686e4_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_2.jpg saved to cache
2025-12-04 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 32c741c9-0956-5169-aca3-197f07605d36
2025-12-04 20:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92030690>
2025-12-04 20:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_11.jpg HTTP/1.1" 201 0
2025-12-04 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe0dbb812-5543-4640-89f1-765e2ce686e4_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_3.jpg saved to cache
2025-12-04 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 32c741c9-0956-5169-aca3-197f07605d36
2025-12-04 20:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9244ee10>
2025-12-04 20:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_7.jpg HTTP/1.1" 201 0
2025-12-04 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe0dbb812-5543-4640-89f1-765e2ce686e4_10.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_10.jpg saved to cache
2025-12-04 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 32c741c9-0956-5169-aca3-197f07605d36
2025-12-04 20:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92061e10>
2025-12-04 20:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_8.jpg HTTP/1.1" 201 0
2025-12-04 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe0dbb812-5543-4640-89f1-765e2ce686e4_9.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_9.jpg saved to cache
2025-12-04 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 32c741c9-0956-5169-aca3-197f07605d36
2025-12-04 20:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2216514-4008410-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002216514-01992292-001.pdf)
2025-12-04 20:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/MICRA?id=2213009&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232213009&indx=67> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 20:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2216514-4008410-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002216514-01992292-001.pdf)
2025-12-04 20:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2216514-4008410-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002216514-01992292-001.pdf)
2025-12-04 20:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2216514-4008410-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002216514-01992292-001.pdf)
2025-12-04 20:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92378450>
2025-12-04 20:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_15.jpg HTTP/1.1" 201 0
2025-12-04 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2216514-4008410-1001.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2216514-4008410-1001.jpg saved to cache
2025-12-04 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 32c741c9-0956-5169-aca3-197f07605d36
2025-12-04 20:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924de950>
2025-12-04 20:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_12.jpg HTTP/1.1" 201 0
2025-12-04 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe0dbb812-5543-4640-89f1-765e2ce686e4_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_4.jpg saved to cache
2025-12-04 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 32c741c9-0956-5169-aca3-197f07605d36
2025-12-04 20:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c920441d0>
2025-12-04 20:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_17.jpg HTTP/1.1" 201 0
2025-12-04 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2216514-4008410-1003.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2216514-4008410-1003.jpg saved to cache
2025-12-04 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 32c741c9-0956-5169-aca3-197f07605d36
2025-12-04 20:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924dae50>
2025-12-04 20:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_16.jpg HTTP/1.1" 201 0
2025-12-04 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2216514-4008410-1002.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2216514-4008410-1002.jpg saved to cache
2025-12-04 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 32c741c9-0956-5169-aca3-197f07605d36
2025-12-04 20:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92164fd0>
2025-12-04 20:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_13.jpg HTTP/1.1" 201 0
2025-12-04 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2216514-4008410-13.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2216514-4008410-13.jpg saved to cache
2025-12-04 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 32c741c9-0956-5169-aca3-197f07605d36
2025-12-04 20:02:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac1fbe31-999f-51e2-925d-cdc49202a6d0 with identifier: 2213009
2025-12-04 20:02:45 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ac1fbe31-999f-51e2-925d-cdc49202a6d0
2025-12-04 20:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c920d9650>
2025-12-04 20:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_14.jpg HTTP/1.1" 201 0
2025-12-04 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2216514-4008410-1000.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2216514-4008410-1000.jpg saved to cache
2025-12-04 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 32c741c9-0956-5169-aca3-197f07605d36
2025-12-04 20:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92338b50>
2025-12-04 20:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_18.jpg HTTP/1.1" 201 0
2025-12-04 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2216514-4008410-1004.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2216514-4008410-1004.jpg saved to cache
2025-12-04 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 32c741c9-0956-5169-aca3-197f07605d36
2025-12-04 20:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92339950>
2025-12-04 20:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_19.jpg HTTP/1.1" 201 0
2025-12-04 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2216514-4008410-1005.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2216514-4008410-1005.jpg saved to cache
2025-12-04 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 32c741c9-0956-5169-aca3-197f07605d36
2025-12-04 20:02:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 32c741c9-0956-5169-aca3-197f07605d36, skipping ID generation
2025-12-04 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 32c741c9-0956-5169-aca3-197f07605d36 from tracking dictionaries
2025-12-04 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 32c741c9-0956-5169-aca3-197f07605d36 sending to next pipeline
2025-12-04 20:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 32c741c9-0956-5169-aca3-197f07605d36, identifier: 2216514
2025-12-04 20:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 32c741c9-0956-5169-aca3-197f07605d36 with identifier: 2216514
2025-12-04 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 20:02:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BROWN HTTP/1.1" 200 None
2025-12-04 20:02:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 20:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 32c741c9-0956-5169-aca3-197f07605d36 with identifier: 2216514
2025-12-04 20:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 32c741c9-0956-5169-aca3-197f07605d36 with identifier: 2216514 to the API
2025-12-04 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 20:02:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 20:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-2216514-4008410-1005.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_expert_report_file_a7bd2619-d858-421f-8e05-769c0f37cf31.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002216514-01992292-001.pdf',
 'color': 'BROWN',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': '2025-12-10T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '32c741c9-0956-5169-aca3-197f07605d36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'DY67OMA',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/ASTRA?id=2216514',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'VAUXHALL',
 'model': 'ASTRA',
 'odometer': 47158,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 30,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192865,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192865,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 173314,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 170307,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193136,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193564,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 188860,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198062,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203834,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186293,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 169299,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 182110,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176971,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e0dbb812-5543-4640-89f1-765e2ce686e4_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284251,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2216514-4008410-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191710,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2216514-4008410-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 172102,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2216514-4008410-1001.jpg',
             'Width': 749},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227994,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2216514-4008410-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229374,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2216514-4008410-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187158,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2216514-4008410-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32c741c9-0956-5169-aca3-197f07605d36/32c741c9-0956-5169-aca3-197f07605d36_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 156298,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2216514-4008410-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-08',
 'seller_name': 'Available Car',
 'title': 'VAUXHALL ASTRA 1.4T 16V 150 Elite Nav 5dr',
 'transmission': 'manual',
 'trim': '1.4T 16V 150 Elite Nav 5dr',
 'year': 2017}
2025-12-04 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272216514%27 HTTP/1.1" 200 None
2025-12-04 20:02:46 [manheim.gb] INFO: Saving data for 2216514: {'created_time': 1764878566.879414, 'last_price_update_time': 1764878566.879424, 'auction_closing_time': 1765357200.0}
2025-12-04 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2216514') HTTP/1.1" 204 0
2025-12-04 20:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002171364-01986727-002.pdf> (referer: None)
2025-12-04 20:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92233250>
2025-12-04 20:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_expert_report_file_5b57588d-881d-4e83-9a81-dd8e84fde114.pdf HTTP/1.1" 201 0
2025-12-04 20:02:47 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9898389f-0af9-5e3f-9710-9e3dace200a3
2025-12-04 20:02:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9898389f-0af9-5e3f-9710-9e3dace200a3, skipping ID generation
2025-12-04 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 9898389f-0af9-5e3f-9710-9e3dace200a3
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_7.jpg not downloaded yet
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_7.jpg not downloaded yet
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_6.jpg not downloaded yet
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_1.jpg not downloaded yet
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_5.jpg not downloaded yet
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_4.jpg not downloaded yet
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_11.jpg not downloaded yet
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_10.jpg not downloaded yet
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_9.jpg not downloaded yet
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_2.jpg not downloaded yet
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_5.jpg not downloaded yet
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_3.jpg not downloaded yet
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_4.jpg not downloaded yet
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2171364-4008031-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2171364-4008031-13.jpg not downloaded yet
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2171364-4008031-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2171364-4008031-1000.jpg not downloaded yet
2025-12-04 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002171364-01986727-002.pdf)
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2171364-4008031-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2171364-4008031-1001.jpg not downloaded yet
2025-12-04 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002171364-01986727-002.pdf)
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2171364-4008031-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2171364-4008031-1002.jpg not downloaded yet
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2171364-4008031-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2171364-4008031-1003.jpg not downloaded yet
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2171364-4008031-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2171364-4008031-1004.jpg not downloaded yet
2025-12-04 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002213009-01990967-001.pdf> (referer: None)
2025-12-04 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002171364-01986727-002.pdf)
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2171364-4008031-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2171364-4008031-1005.jpg not downloaded yet
2025-12-04 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002171364-01986727-002.pdf)
2025-12-04 20:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91bab710>
2025-12-04 20:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_0.jpg HTTP/1.1" 201 0
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_7.jpg saved to cache
2025-12-04 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9898389f-0af9-5e3f-9710-9e3dace200a3
2025-12-04 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002171364-01986727-002.pdf)
2025-12-04 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002171364-01986727-002.pdf)
2025-12-04 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002171364-01986727-002.pdf)
2025-12-04 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002171364-01986727-002.pdf)
2025-12-04 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002171364-01986727-002.pdf)
2025-12-04 20:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92338290>
2025-12-04 20:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_1.jpg HTTP/1.1" 201 0
2025-12-04 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_7.jpg saved to cache
2025-12-04 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9898389f-0af9-5e3f-9710-9e3dace200a3
2025-12-04 20:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92439390>
2025-12-04 20:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_expert_report_file_fcda5438-816c-45be-a4b3-6d8fc78fa9cb.pdf HTTP/1.1" 201 0
2025-12-04 20:02:48 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ac1fbe31-999f-51e2-925d-cdc49202a6d0
2025-12-04 20:02:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac1fbe31-999f-51e2-925d-cdc49202a6d0, skipping ID generation
2025-12-04 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item ac1fbe31-999f-51e2-925d-cdc49202a6d0
2025-12-04 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_7.jpg not downloaded yet
2025-12-04 20:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9213d2d0>
2025-12-04 20:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_2.jpg HTTP/1.1" 201 0
2025-12-04 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_6.jpg saved to cache
2025-12-04 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9898389f-0af9-5e3f-9710-9e3dace200a3
2025-12-04 20:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9229c450>
2025-12-04 20:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_3.jpg HTTP/1.1" 201 0
2025-12-04 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_1.jpg saved to cache
2025-12-04 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9898389f-0af9-5e3f-9710-9e3dace200a3
2025-12-04 20:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002171364-01986727-002.pdf)
2025-12-04 20:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002171364-01986727-002.pdf)
2025-12-04 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_7.jpg not downloaded yet
2025-12-04 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_6.jpg not downloaded yet
2025-12-04 20:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a5a8d0>
2025-12-04 20:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_4.jpg HTTP/1.1" 201 0
2025-12-04 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_5.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_5.jpg saved to cache
2025-12-04 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9898389f-0af9-5e3f-9710-9e3dace200a3
2025-12-04 20:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c920e4c50>
2025-12-04 20:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_5.jpg HTTP/1.1" 201 0
2025-12-04 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_4.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_4.jpg saved to cache
2025-12-04 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9898389f-0af9-5e3f-9710-9e3dace200a3
2025-12-04 20:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92256bd0>
2025-12-04 20:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_6.jpg HTTP/1.1" 201 0
2025-12-04 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_11.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_11.jpg saved to cache
2025-12-04 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9898389f-0af9-5e3f-9710-9e3dace200a3
2025-12-04 20:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92385ed0>
2025-12-04 20:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_7.jpg HTTP/1.1" 201 0
2025-12-04 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_10.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_10.jpg saved to cache
2025-12-04 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9898389f-0af9-5e3f-9710-9e3dace200a3
2025-12-04 20:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a94ed0>
2025-12-04 20:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_8.jpg HTTP/1.1" 201 0
2025-12-04 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_9.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_9.jpg saved to cache
2025-12-04 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9898389f-0af9-5e3f-9710-9e3dace200a3
2025-12-04 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002171364-01986727-002.pdf)
2025-12-04 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002171364-01986727-002.pdf)
2025-12-04 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_1.jpg not downloaded yet
2025-12-04 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2171364-4008031-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002171364-01986727-002.pdf)
2025-12-04 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F434d5bce-cfb4-4c50-8233-81d4f2a28256_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_5.jpg not downloaded yet
2025-12-04 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2171364-4008031-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002171364-01986727-002.pdf)
2025-12-04 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2171364-4008031-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002171364-01986727-002.pdf)
2025-12-04 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2171364-4008031-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002171364-01986727-002.pdf)
2025-12-04 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F434d5bce-cfb4-4c50-8233-81d4f2a28256_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_4.jpg not downloaded yet
2025-12-04 20:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92084a90>
2025-12-04 20:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_9.jpg HTTP/1.1" 201 0
2025-12-04 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_2.jpg saved to cache
2025-12-04 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9898389f-0af9-5e3f-9710-9e3dace200a3
2025-12-04 20:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92345510>
2025-12-04 20:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_10.jpg HTTP/1.1" 201 0
2025-12-04 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_5.jpg saved to cache
2025-12-04 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9898389f-0af9-5e3f-9710-9e3dace200a3
2025-12-04 20:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2171364-4008031-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002171364-01986727-002.pdf)
2025-12-04 20:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2171364-4008031-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002171364-01986727-002.pdf)
2025-12-04 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F434d5bce-cfb4-4c50-8233-81d4f2a28256_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_11.jpg not downloaded yet
2025-12-04 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F434d5bce-cfb4-4c50-8233-81d4f2a28256_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_10.jpg not downloaded yet
2025-12-04 20:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213009-01990967-001.pdf)
2025-12-04 20:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213009-01990967-001.pdf)
2025-12-04 20:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c921ab710>
2025-12-04 20:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_11.jpg HTTP/1.1" 201 0
2025-12-04 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_3.jpg saved to cache
2025-12-04 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9898389f-0af9-5e3f-9710-9e3dace200a3
2025-12-04 20:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9214d4d0>
2025-12-04 20:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_12.jpg HTTP/1.1" 201 0
2025-12-04 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_4.jpg saved to cache
2025-12-04 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9898389f-0af9-5e3f-9710-9e3dace200a3
2025-12-04 20:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a81b10>
2025-12-04 20:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_13.jpg HTTP/1.1" 201 0
2025-12-04 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2171364-4008031-13.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2171364-4008031-13.jpg saved to cache
2025-12-04 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9898389f-0af9-5e3f-9710-9e3dace200a3
2025-12-04 20:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9214fd10>
2025-12-04 20:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_14.jpg HTTP/1.1" 201 0
2025-12-04 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2171364-4008031-1000.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2171364-4008031-1000.jpg saved to cache
2025-12-04 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 9898389f-0af9-5e3f-9710-9e3dace200a3
2025-12-04 20:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c923bb6d0>
2025-12-04 20:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_17.jpg HTTP/1.1" 201 0
2025-12-04 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2171364-4008031-1003.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2171364-4008031-1003.jpg saved to cache
2025-12-04 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 9898389f-0af9-5e3f-9710-9e3dace200a3
2025-12-04 20:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c923d3990>
2025-12-04 20:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_18.jpg HTTP/1.1" 201 0
2025-12-04 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2171364-4008031-1004.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2171364-4008031-1004.jpg saved to cache
2025-12-04 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 9898389f-0af9-5e3f-9710-9e3dace200a3
2025-12-04 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2171364-4008031-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002171364-01986727-002.pdf)
2025-12-04 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F434d5bce-cfb4-4c50-8233-81d4f2a28256_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_9.jpg not downloaded yet
2025-12-04 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_2.jpg not downloaded yet
2025-12-04 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213009-01990967-001.pdf)
2025-12-04 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213009-01990967-001.pdf)
2025-12-04 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213009-01990967-001.pdf)
2025-12-04 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_5.jpg not downloaded yet
2025-12-04 20:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91abd610>
2025-12-04 20:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_19.jpg HTTP/1.1" 201 0
2025-12-04 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2171364-4008031-1005.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2171364-4008031-1005.jpg saved to cache
2025-12-04 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 9898389f-0af9-5e3f-9710-9e3dace200a3
2025-12-04 20:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9238ef50>
2025-12-04 20:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_15.jpg HTTP/1.1" 201 0
2025-12-04 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2171364-4008031-1001.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2171364-4008031-1001.jpg saved to cache
2025-12-04 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 9898389f-0af9-5e3f-9710-9e3dace200a3
2025-12-04 20:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924e6a90>
2025-12-04 20:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_1.jpg HTTP/1.1" 201 0
2025-12-04 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_7.jpg saved to cache
2025-12-04 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ac1fbe31-999f-51e2-925d-cdc49202a6d0
2025-12-04 20:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9230a010>
2025-12-04 20:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_0.jpg HTTP/1.1" 201 0
2025-12-04 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_7.jpg saved to cache
2025-12-04 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac1fbe31-999f-51e2-925d-cdc49202a6d0
2025-12-04 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213009-01990967-001.pdf)
2025-12-04 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_3.jpg not downloaded yet
2025-12-04 20:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213009-01990967-001.pdf)
2025-12-04 20:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213009-01990967-001.pdf)
2025-12-04 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_4.jpg not downloaded yet
2025-12-04 20:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213009-01990967-001.pdf)
2025-12-04 20:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9236ca50>
2025-12-04 20:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_16.jpg HTTP/1.1" 201 0
2025-12-04 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2171364-4008031-1002.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2171364-4008031-1002.jpg saved to cache
2025-12-04 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 9898389f-0af9-5e3f-9710-9e3dace200a3
2025-12-04 20:02:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9898389f-0af9-5e3f-9710-9e3dace200a3, skipping ID generation
2025-12-04 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9898389f-0af9-5e3f-9710-9e3dace200a3 from tracking dictionaries
2025-12-04 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9898389f-0af9-5e3f-9710-9e3dace200a3 sending to next pipeline
2025-12-04 20:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 9898389f-0af9-5e3f-9710-9e3dace200a3, identifier: 2171364
2025-12-04 20:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a87e90>
2025-12-04 20:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_3.jpg HTTP/1.1" 201 0
2025-12-04 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_1.jpg saved to cache
2025-12-04 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ac1fbe31-999f-51e2-925d-cdc49202a6d0
2025-12-04 20:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a53150>
2025-12-04 20:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_5.jpg HTTP/1.1" 201 0
2025-12-04 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F434d5bce-cfb4-4c50-8233-81d4f2a28256_4.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_4.jpg saved to cache
2025-12-04 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ac1fbe31-999f-51e2-925d-cdc49202a6d0
2025-12-04 20:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9236d450>
2025-12-04 20:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_4.jpg HTTP/1.1" 201 0
2025-12-04 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F434d5bce-cfb4-4c50-8233-81d4f2a28256_5.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_5.jpg saved to cache
2025-12-04 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ac1fbe31-999f-51e2-925d-cdc49202a6d0
2025-12-04 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213009-4008707-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213009-4008707-13.jpg not downloaded yet
2025-12-04 20:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 9898389f-0af9-5e3f-9710-9e3dace200a3 with identifier: 2171364
2025-12-04 20:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 9898389f-0af9-5e3f-9710-9e3dace200a3 with identifier: 2171364
2025-12-04 20:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 9898389f-0af9-5e3f-9710-9e3dace200a3 with identifier: 2171364 to the API
2025-12-04 20:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 20:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 20:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-2171364-4008031-1002.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_expert_report_file_5b57588d-881d-4e83-9a81-dd8e84fde114.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002171364-01986727-002.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '2.2L',
 'expiration_date': '2025-12-11T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '9898389f-0af9-5e3f-9710-9e3dace200a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'AF66NUE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/CLA?id=2171364',
 'listing': 'auction',
 'location': 'Northampton',
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 89590,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 27,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231313,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231313,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296230,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205488,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229649,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224374,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230076,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229576,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237864,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310151,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265619,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283962,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303235,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0e6c8fac-9cf4-4d2b-b3af-b1f6e5736cb4_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344353,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2171364-4008031-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210635,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2171364-4008031-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261979,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2171364-4008031-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290596,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2171364-4008031-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251832,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2171364-4008031-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243561,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2171364-4008031-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9898389f-0af9-5e3f-9710-9e3dace200a3/9898389f-0af9-5e3f-9710-9e3dace200a3_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267493,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2171364-4008031-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-28',
 'seller_name': 'Vindis Group',
 'title': 'MERCEDES-BENZ CLA CLA 200d Sport 5dr Tip Auto',
 'transmission': 'automatic',
 'trim': 'CLA 200d Sport 5dr Tip Auto',
 'year': 2016}
2025-12-04 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272171364%27 HTTP/1.1" 200 None
2025-12-04 20:02:55 [manheim.gb] INFO: Saving data for 2171364: {'created_time': 1764878575.866139, 'last_price_update_time': 1764878575.866151, 'auction_closing_time': 1765443600.0}
2025-12-04 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2171364') HTTP/1.1" 204 0
2025-12-04 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213009-4008707-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213009-4008707-1000.jpg not downloaded yet
2025-12-04 20:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91bf1550>
2025-12-04 20:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_2.jpg HTTP/1.1" 201 0
2025-12-04 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_6.jpg saved to cache
2025-12-04 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ac1fbe31-999f-51e2-925d-cdc49202a6d0
2025-12-04 20:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9207ccd0>
2025-12-04 20:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_8.jpg HTTP/1.1" 201 0
2025-12-04 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F434d5bce-cfb4-4c50-8233-81d4f2a28256_9.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_9.jpg saved to cache
2025-12-04 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ac1fbe31-999f-51e2-925d-cdc49202a6d0
2025-12-04 20:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91bb8090>
2025-12-04 20:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_7.jpg HTTP/1.1" 201 0
2025-12-04 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F434d5bce-cfb4-4c50-8233-81d4f2a28256_10.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_10.jpg saved to cache
2025-12-04 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ac1fbe31-999f-51e2-925d-cdc49202a6d0
2025-12-04 20:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c924dee50>
2025-12-04 20:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_6.jpg HTTP/1.1" 201 0
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F434d5bce-cfb4-4c50-8233-81d4f2a28256_11.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_11.jpg saved to cache
2025-12-04 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ac1fbe31-999f-51e2-925d-cdc49202a6d0
2025-12-04 20:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213009-01990967-001.pdf)
2025-12-04 20:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213009-01990967-001.pdf)
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213009-4008707-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213009-4008707-1001.jpg not downloaded yet
2025-12-04 20:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213009-01990967-001.pdf)
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213009-4008707-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213009-4008707-1002.jpg not downloaded yet
2025-12-04 20:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213009-01990967-001.pdf)
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213009-4008707-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213009-4008707-1003.jpg not downloaded yet
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213009-4008707-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213009-4008707-1004.jpg not downloaded yet
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213009-4008707-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213009-4008707-1005.jpg not downloaded yet
2025-12-04 20:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a73510>
2025-12-04 20:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_9.jpg HTTP/1.1" 201 0
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_2.jpg saved to cache
2025-12-04 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ac1fbe31-999f-51e2-925d-cdc49202a6d0
2025-12-04 20:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c923ec590>
2025-12-04 20:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_10.jpg HTTP/1.1" 201 0
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_5.jpg saved to cache
2025-12-04 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ac1fbe31-999f-51e2-925d-cdc49202a6d0
2025-12-04 20:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2213009-4008707-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213009-01990967-001.pdf)
2025-12-04 20:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2213009-4008707-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213009-01990967-001.pdf)
2025-12-04 20:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c923edb90>
2025-12-04 20:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_11.jpg HTTP/1.1" 201 0
2025-12-04 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_3.jpg saved to cache
2025-12-04 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ac1fbe31-999f-51e2-925d-cdc49202a6d0
2025-12-04 20:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92386490>
2025-12-04 20:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_12.jpg HTTP/1.1" 201 0
2025-12-04 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_4.jpg saved to cache
2025-12-04 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ac1fbe31-999f-51e2-925d-cdc49202a6d0
2025-12-04 20:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2213009-4008707-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213009-01990967-001.pdf)
2025-12-04 20:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2213009-4008707-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213009-01990967-001.pdf)
2025-12-04 20:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2213009-4008707-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213009-01990967-001.pdf)
2025-12-04 20:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2213009-4008707-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213009-01990967-001.pdf)
2025-12-04 20:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2213009-4008707-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213009-01990967-001.pdf)
2025-12-04 20:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c923bb8d0>
2025-12-04 20:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_15.jpg HTTP/1.1" 201 0
2025-12-04 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213009-4008707-1001.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213009-4008707-1001.jpg saved to cache
2025-12-04 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item ac1fbe31-999f-51e2-925d-cdc49202a6d0
2025-12-04 20:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a73f90>
2025-12-04 20:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_14.jpg HTTP/1.1" 201 0
2025-12-04 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213009-4008707-1000.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213009-4008707-1000.jpg saved to cache
2025-12-04 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item ac1fbe31-999f-51e2-925d-cdc49202a6d0
2025-12-04 20:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92195b90>
2025-12-04 20:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_13.jpg HTTP/1.1" 201 0
2025-12-04 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213009-4008707-13.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213009-4008707-13.jpg saved to cache
2025-12-04 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ac1fbe31-999f-51e2-925d-cdc49202a6d0
2025-12-04 20:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92302d90>
2025-12-04 20:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_17.jpg HTTP/1.1" 201 0
2025-12-04 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213009-4008707-1003.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213009-4008707-1003.jpg saved to cache
2025-12-04 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item ac1fbe31-999f-51e2-925d-cdc49202a6d0
2025-12-04 20:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92386f10>
2025-12-04 20:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 20:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_19.jpg HTTP/1.1" 201 0
2025-12-04 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213009-4008707-1005.jpg') HTTP/1.1" 204 0
2025-12-04 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213009-4008707-1005.jpg saved to cache
2025-12-04 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item ac1fbe31-999f-51e2-925d-cdc49202a6d0
2025-12-04 20:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9233a650>
2025-12-04 20:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_16.jpg HTTP/1.1" 201 0
2025-12-04 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213009-4008707-1002.jpg') HTTP/1.1" 204 0
2025-12-04 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213009-4008707-1002.jpg saved to cache
2025-12-04 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item ac1fbe31-999f-51e2-925d-cdc49202a6d0
2025-12-04 20:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92339910>
2025-12-04 20:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_18.jpg HTTP/1.1" 201 0
2025-12-04 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213009-4008707-1004.jpg') HTTP/1.1" 204 0
2025-12-04 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213009-4008707-1004.jpg saved to cache
2025-12-04 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item ac1fbe31-999f-51e2-925d-cdc49202a6d0
2025-12-04 20:03:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac1fbe31-999f-51e2-925d-cdc49202a6d0, skipping ID generation
2025-12-04 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ac1fbe31-999f-51e2-925d-cdc49202a6d0 from tracking dictionaries
2025-12-04 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac1fbe31-999f-51e2-925d-cdc49202a6d0 sending to next pipeline
2025-12-04 20:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: ac1fbe31-999f-51e2-925d-cdc49202a6d0, identifier: 2213009
2025-12-04 20:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: ac1fbe31-999f-51e2-925d-cdc49202a6d0 with identifier: 2213009
2025-12-04 20:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: ac1fbe31-999f-51e2-925d-cdc49202a6d0 with identifier: 2213009
2025-12-04 20:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-04 20:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: ac1fbe31-999f-51e2-925d-cdc49202a6d0 spider: manheim.gb
2025-12-04 20:03:00 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: ac1fbe31-999f-51e2-925d-cdc49202a6d0 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_expert_report_file_fcda5438-816c-45be-a4b3-6d8fc78fa9cb.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002213009-01990967-001.pdf',
 'color': 'Red',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-11T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ac1fbe31-999f-51e2-925d-cdc49202a6d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RA65XOC',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/MICRA?id=2213009',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'NISSAN',
 'model': 'MICRA',
 'odometer': 65227,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 27,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239355,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239355,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293818,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 172258,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214130,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195485,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213036,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 182932,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186241,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226379,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234805,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255282,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232347,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/434d5bce-cfb4-4c50-8233-81d4f2a28256_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305300,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2213009-4008707-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252171,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2213009-4008707-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190021,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2213009-4008707-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345925,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2213009-4008707-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275844,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2213009-4008707-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 400098,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2213009-4008707-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac1fbe31-999f-51e2-925d-cdc49202a6d0/ac1fbe31-999f-51e2-925d-cdc49202a6d0_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 182304,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2213009-4008707-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-31',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'NISSAN MICRA 1.2 Acenta 5dr',
 'transmission': 'manual',
 'trim': '1.2 Acenta 5dr',
 'year': 2015}
2025-12-04 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272213009%27 HTTP/1.1" 200 None
2025-12-04 20:03:00 [manheim.gb] INFO: Saving data for 2213009: {'created_time': 1764878580.828179, 'last_price_update_time': 1764878580.828191, 'auction_closing_time': 1765443600.0}
2025-12-04 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2213009') HTTP/1.1" 204 0
2025-12-04 20:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/RENAULT/KADJAR?id=2107189&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232107189&indx=63> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 20:03:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf438224-774a-507f-9dde-cb21028e54e6 with identifier: 2107189
2025-12-04 20:03:01 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item cf438224-774a-507f-9dde-cb21028e54e6
2025-12-04 20:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002107189-01993487-003.pdf> (referer: None)
2025-12-04 20:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91abe9d0>
2025-12-04 20:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_expert_report_file_dcb05f48-6270-4b0a-9dcb-5d96038cf6e0.pdf HTTP/1.1" 201 0
2025-12-04 20:03:02 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item cf438224-774a-507f-9dde-cb21028e54e6
2025-12-04 20:03:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf438224-774a-507f-9dde-cb21028e54e6, skipping ID generation
2025-12-04 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item cf438224-774a-507f-9dde-cb21028e54e6
2025-12-04 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2107189-9999999-338130101-004.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-004.jpg not downloaded yet
2025-12-04 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2107189-9999999-338130101-008.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-008.jpg not downloaded yet
2025-12-04 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2107189-9999999-338130101-001.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-001.jpg not downloaded yet
2025-12-04 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2107189-9999999-338130101-002.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-002.jpg not downloaded yet
2025-12-04 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2107189-9999999-338130101-003.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-003.jpg not downloaded yet
2025-12-04 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2107189-9999999-338130101-005.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-005.jpg not downloaded yet
2025-12-04 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2107189-9999999-338130101-006.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-006.jpg not downloaded yet
2025-12-04 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2107189-9999999-338130101-007.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-007.jpg not downloaded yet
2025-12-04 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2107189-9999999-338130101-009.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-009.jpg not downloaded yet
2025-12-04 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2107189-9999999-338130101-010.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-010.jpg not downloaded yet
2025-12-04 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2107189-9999999-338130101-011.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-011.jpg not downloaded yet
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2107189-9999999-338130101-012.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-012.jpg not downloaded yet
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2107189-4008070-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-13.jpg not downloaded yet
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2107189-4008070-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-1000.jpg not downloaded yet
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2107189-4008070-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-1001.jpg not downloaded yet
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2107189-4008070-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-1002.jpg not downloaded yet
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2107189-4008070-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-1003.jpg not downloaded yet
2025-12-04 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-008.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002107189-01993487-003.pdf)
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2107189-4008070-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-1004.jpg not downloaded yet
2025-12-04 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002107189-01993487-003.pdf)
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2107189-4008070-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-1005.jpg not downloaded yet
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2107189-4008070-1006.jpg%27 HTTP/1.1" 200 None
2025-12-04 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-1006.jpg not downloaded yet
2025-12-04 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002107189-01993487-003.pdf)
2025-12-04 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002107189-01993487-003.pdf)
2025-12-04 20:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a5be10>
2025-12-04 20:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_1.jpg HTTP/1.1" 201 0
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2107189-9999999-338130101-008.jpg') HTTP/1.1" 204 0
2025-12-04 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-008.jpg saved to cache
2025-12-04 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf438224-774a-507f-9dde-cb21028e54e6
2025-12-04 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002107189-01993487-003.pdf)
2025-12-04 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-007.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002107189-01993487-003.pdf)
2025-12-04 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002107189-01993487-003.pdf)
2025-12-04 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-010.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002107189-01993487-003.pdf)
2025-12-04 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002107189-01993487-003.pdf)
2025-12-04 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-009.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002107189-01993487-003.pdf)
2025-12-04 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-012.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002107189-01993487-003.pdf)
2025-12-04 20:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92061110>
2025-12-04 20:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_0.jpg HTTP/1.1" 201 0
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2107189-9999999-338130101-004.jpg') HTTP/1.1" 204 0
2025-12-04 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-004.jpg saved to cache
2025-12-04 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf438224-774a-507f-9dde-cb21028e54e6
2025-12-04 20:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c921abfd0>
2025-12-04 20:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_3.jpg HTTP/1.1" 201 0
2025-12-04 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2107189-9999999-338130101-002.jpg') HTTP/1.1" 204 0
2025-12-04 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-002.jpg saved to cache
2025-12-04 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf438224-774a-507f-9dde-cb21028e54e6
2025-12-04 20:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a3fe10>
2025-12-04 20:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_2.jpg HTTP/1.1" 201 0
2025-12-04 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2107189-9999999-338130101-001.jpg') HTTP/1.1" 204 0
2025-12-04 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-001.jpg saved to cache
2025-12-04 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf438224-774a-507f-9dde-cb21028e54e6
2025-12-04 20:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-011.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002107189-01993487-003.pdf)
2025-12-04 20:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002107189-01993487-003.pdf)
2025-12-04 20:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002107189-01993487-003.pdf)
2025-12-04 20:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002107189-01993487-003.pdf)
2025-12-04 20:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a5c710>
2025-12-04 20:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_4.jpg HTTP/1.1" 201 0
2025-12-04 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2107189-9999999-338130101-003.jpg') HTTP/1.1" 204 0
2025-12-04 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-003.jpg saved to cache
2025-12-04 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf438224-774a-507f-9dde-cb21028e54e6
2025-12-04 20:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9221b2d0>
2025-12-04 20:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_7.jpg HTTP/1.1" 201 0
2025-12-04 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2107189-9999999-338130101-007.jpg') HTTP/1.1" 204 0
2025-12-04 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-007.jpg saved to cache
2025-12-04 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cf438224-774a-507f-9dde-cb21028e54e6
2025-12-04 20:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c921a3090>
2025-12-04 20:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_6.jpg HTTP/1.1" 201 0
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2107189-9999999-338130101-006.jpg') HTTP/1.1" 204 0
2025-12-04 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-006.jpg saved to cache
2025-12-04 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf438224-774a-507f-9dde-cb21028e54e6
2025-12-04 20:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92132e90>
2025-12-04 20:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_9.jpg HTTP/1.1" 201 0
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2107189-9999999-338130101-010.jpg') HTTP/1.1" 204 0
2025-12-04 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-010.jpg saved to cache
2025-12-04 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cf438224-774a-507f-9dde-cb21028e54e6
2025-12-04 20:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9221bd90>
2025-12-04 20:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_5.jpg HTTP/1.1" 201 0
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2107189-9999999-338130101-005.jpg') HTTP/1.1" 204 0
2025-12-04 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-005.jpg saved to cache
2025-12-04 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf438224-774a-507f-9dde-cb21028e54e6
2025-12-04 20:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91ac5450>
2025-12-04 20:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_8.jpg HTTP/1.1" 201 0
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2107189-9999999-338130101-009.jpg') HTTP/1.1" 204 0
2025-12-04 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-009.jpg saved to cache
2025-12-04 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cf438224-774a-507f-9dde-cb21028e54e6
2025-12-04 20:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91ac6110>
2025-12-04 20:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_11.jpg HTTP/1.1" 201 0
2025-12-04 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2107189-9999999-338130101-012.jpg') HTTP/1.1" 204 0
2025-12-04 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-012.jpg saved to cache
2025-12-04 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item cf438224-774a-507f-9dde-cb21028e54e6
2025-12-04 20:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002107189-01993487-003.pdf)
2025-12-04 20:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002107189-01993487-003.pdf)
2025-12-04 20:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002107189-01993487-003.pdf)
2025-12-04 20:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92119090>
2025-12-04 20:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_10.jpg HTTP/1.1" 201 0
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2107189-9999999-338130101-011.jpg') HTTP/1.1" 204 0
2025-12-04 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-011.jpg saved to cache
2025-12-04 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item cf438224-774a-507f-9dde-cb21028e54e6
2025-12-04 20:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a69a90>
2025-12-04 20:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_13.jpg HTTP/1.1" 201 0
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2107189-4008070-1000.jpg') HTTP/1.1" 204 0
2025-12-04 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-1000.jpg saved to cache
2025-12-04 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item cf438224-774a-507f-9dde-cb21028e54e6
2025-12-04 20:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a52c50>
2025-12-04 20:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_15.jpg HTTP/1.1" 201 0
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2107189-4008070-1002.jpg') HTTP/1.1" 204 0
2025-12-04 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-1002.jpg saved to cache
2025-12-04 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item cf438224-774a-507f-9dde-cb21028e54e6
2025-12-04 20:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a69dd0>
2025-12-04 20:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_14.jpg HTTP/1.1" 201 0
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2107189-4008070-1001.jpg') HTTP/1.1" 204 0
2025-12-04 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-1001.jpg saved to cache
2025-12-04 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item cf438224-774a-507f-9dde-cb21028e54e6
2025-12-04 20:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-1006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002107189-01993487-003.pdf)
2025-12-04 20:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002107189-01993487-003.pdf)
2025-12-04 20:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92158a10>
2025-12-04 20:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_12.jpg HTTP/1.1" 201 0
2025-12-04 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2107189-4008070-13.jpg') HTTP/1.1" 204 0
2025-12-04 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-13.jpg saved to cache
2025-12-04 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item cf438224-774a-507f-9dde-cb21028e54e6
2025-12-04 20:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c92439450>
2025-12-04 20:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_18.jpg HTTP/1.1" 201 0
2025-12-04 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2107189-4008070-1005.jpg') HTTP/1.1" 204 0
2025-12-04 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-1005.jpg saved to cache
2025-12-04 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item cf438224-774a-507f-9dde-cb21028e54e6
2025-12-04 20:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c91a6be50>
2025-12-04 20:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_16.jpg HTTP/1.1" 201 0
2025-12-04 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2107189-4008070-1003.jpg') HTTP/1.1" 204 0
2025-12-04 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-1003.jpg saved to cache
2025-12-04 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item cf438224-774a-507f-9dde-cb21028e54e6
2025-12-04 20:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c9225df90>
2025-12-04 20:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_19.jpg HTTP/1.1" 201 0
2025-12-04 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2107189-4008070-1006.jpg') HTTP/1.1" 204 0
2025-12-04 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-1006.jpg saved to cache
2025-12-04 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item cf438224-774a-507f-9dde-cb21028e54e6
2025-12-04 20:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 20:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 20:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 20:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6c922e2150>
2025-12-04 20:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 20:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 20:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_17.jpg HTTP/1.1" 201 0
2025-12-04 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2107189-4008070-1004.jpg') HTTP/1.1" 204 0
2025-12-04 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-1004.jpg saved to cache
2025-12-04 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item cf438224-774a-507f-9dde-cb21028e54e6
2025-12-04 20:03:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf438224-774a-507f-9dde-cb21028e54e6, skipping ID generation
2025-12-04 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cf438224-774a-507f-9dde-cb21028e54e6 from tracking dictionaries
2025-12-04 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf438224-774a-507f-9dde-cb21028e54e6 sending to next pipeline
2025-12-04 20:03:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: cf438224-774a-507f-9dde-cb21028e54e6, identifier: 2107189
2025-12-04 20:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: cf438224-774a-507f-9dde-cb21028e54e6 with identifier: 2107189
2025-12-04 20:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: cf438224-774a-507f-9dde-cb21028e54e6 with identifier: 2107189
2025-12-04 20:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 168628 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168628
2025-12-04 20:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: cf438224-774a-507f-9dde-cb21028e54e6 spider: manheim.gb
2025-12-04 20:03:08 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: cf438224-774a-507f-9dde-cb21028e54e6 due to rule: high_mileage_for_country.json, error: 168628 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168628
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_expert_report_file_dcb05f48-6270-4b0a-9dcb-5d96038cf6e0.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002107189-01993487-003.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'cf438224-774a-507f-9dde-cb21028e54e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'BV16HYW',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/RENAULT/KADJAR?id=2107189',
 'listing': 'auction',
 'location': 'Washington',
 'make': 'RENAULT',
 'model': 'KADJAR',
 'odometer': 104781,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 30,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195400,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227837,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-008.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 175061,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225146,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206128,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219063,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-005.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 170122,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-006.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194423,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-007.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233613,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-009.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194199,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-010.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203186,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-011.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220368,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2107189-9999999-338130101-012.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326811,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-13.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195279,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-1000.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260146,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-1001.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193153,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-1002.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133296,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-1003.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303182,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-1004.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113211,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-1005.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf438224-774a-507f-9dde-cb21028e54e6/cf438224-774a-507f-9dde-cb21028e54e6_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319311,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2107189-4008070-1006.jpg',
             'Width': 1500}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-04',
 'seller_name': 'Sims Suzuki',
 'title': 'RENAULT KADJAR 1.5 dCi Dynamique Nav 5dr',
 'transmission': 'manual',
 'trim': '1.5 dCi Dynamique Nav 5dr',
 'year': 2016}
2025-12-04 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272107189%27 HTTP/1.1" 200 None
2025-12-04 20:03:08 [manheim.gb] INFO: Saving data for 2107189: {'created_time': 1764878588.840404, 'last_price_update_time': 1764878588.840414, 'auction_closing_time': 1764925200.0}
2025-12-04 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2107189') HTTP/1.1" 204 0
2025-12-04 20:03:08 [scrapy.core.engine] INFO: Closing spider (finished)
2025-12-04 20:03:08 [manheim.gb] INFO: manheim.gb Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2025-12-04 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272283791%27 HTTP/1.1" 200 None
2025-12-04 20:03:09 [manheim.gb] INFO: Saving data for 2283791: {'created_time': 1764878589.009777}
2025-12-04 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2283791') HTTP/1.1" 204 0
2025-12-04 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20last_price_update_time%20lt%201764446589 HTTP/1.1" 200 None
2025-12-04 20:03:09 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (7 items) in: file:///var/lib/scrapyd/items/sourcing_v2/manheim.gb/task_37_2025-12-04T20_00_01.jl
2025-12-04 20:03:09 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 398148,
 'downloader/request_count': 342,
 'downloader/request_method_count/GET': 341,
 'downloader/request_method_count/POST': 1,
 'downloader/response_bytes': 126841147,
 'downloader/response_count': 342,
 'downloader/response_status_count/200': 342,
 'elapsed_time_seconds': 178.11698,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2025, 12, 4, 20, 3, 9, 75388, tzinfo=datetime.timezone.utc),
 'item_dropped_count': 14,
 'item_dropped_reasons_count/DropItem': 14,
 'item_scraped_count': 7,
 'log_count/DEBUG': 3648,
 'log_count/ERROR': 8,
 'log_count/INFO': 3247,
 'memusage/max': 198967296,
 'memusage/startup': 127234048,
 'photo_download_count': 305,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 84,
 'playwright/request_count/aborted': 46,
 'playwright/request_count/method/GET': 81,
 'playwright/request_count/method/POST': 3,
 'playwright/request_count/navigation': 4,
 'playwright/request_count/resource_type/document': 4,
 'playwright/request_count/resource_type/font': 8,
 'playwright/request_count/resource_type/image': 40,
 'playwright/request_count/resource_type/script': 22,
 'playwright/request_count/resource_type/stylesheet': 8,
 'playwright/request_count/resource_type/xhr': 2,
 'playwright/response_count': 38,
 'playwright/response_count/method/GET': 35,
 'playwright/response_count/method/POST': 3,
 'playwright/response_count/resource_type/document': 4,
 'playwright/response_count/resource_type/font': 8,
 'playwright/response_count/resource_type/script': 16,
 'playwright/response_count/resource_type/stylesheet': 8,
 'playwright/response_count/resource_type/xhr': 2,
 'request_depth_max': 4,
 'response_received_count': 37,
 'scheduler/dequeued': 342,
 'scheduler/dequeued/memory': 342,
 'scheduler/enqueued': 342,
 'scheduler/enqueued/memory': 342,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 22,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 30.400059456767686,
 'scrapy-zyte-api/mean_response_seconds': 30.782839363377374,
 'scrapy-zyte-api/processed': 22,
 'scrapy-zyte-api/request_args/actions': 21,
 'scrapy-zyte-api/request_args/browserHtml': 21,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 1,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 22,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 22,
 'scrapy-zyte-api/request_args/httpRequestBody': 1,
 'scrapy-zyte-api/request_args/httpRequestMethod': 1,
 'scrapy-zyte-api/request_args/httpResponseBody': 1,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 1,
 'scrapy-zyte-api/request_args/requestHeaders': 21,
 'scrapy-zyte-api/request_args/sessionContext': 21,
 'scrapy-zyte-api/request_args/url': 22,
 'scrapy-zyte-api/status_codes/200': 22,
 'scrapy-zyte-api/success': 22,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'spider_exceptions/ValueError': 1,
 'start_time': datetime.datetime(2025, 12, 4, 20, 0, 10, 958408, tzinfo=datetime.timezone.utc)}
2025-12-04 20:03:09 [scrapy.core.engine] INFO: Spider closed (finished)