2025-12-02 10:00:20 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2025-12-02 10:00:20 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2025-12-02 10:00:20 [manheim.gb] INFO: Starting spider manheim.gb
2025-12-02 10:00:20 [scrapy.addons] INFO: Enabled addons:
[]
2025-12-02 10:00:20 [asyncio] DEBUG: Using selector: EpollSelector
2025-12-02 10:00:20 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2025-12-02 10:00:20 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2025-12-02 10:00:20 [scrapy.extensions.telnet] INFO: Telnet Password: 7b41932602669623
2025-12-02 10:00:20 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2025-12-02 10:00:20 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/manheim.gb/task_37_2025-12-02T10_00_03.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2025-12-02 10:00:20 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-02 10:00:20 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-02 10:00:20 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2025-12-02 10:00:20 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2025-12-02 10:00:20 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2025-12-02 10:00:20 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2025-12-02 10:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:00:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:00:20 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2025-12-02 10:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2025-12-02 10:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:20 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2025-12-02 10:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2025-12-02 10:00:20 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2025-12-02 10:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2025-12-02 10:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2025-12-02 10:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2025-12-02 10:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2025-12-02 10:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2025-12-02 10:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2025-12-02 10:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2025-12-02 10:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2025-12-02 10:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2025-12-02 10:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2025-12-02 10:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2025-12-02 10:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2025-12-02 10:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2025-12-02 10:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2025-12-02 10:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2025-12-02 10:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2025-12-02 10:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2025-12-02 10:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2025-12-02 10:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2025-12-02 10:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2025-12-02 10:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2025-12-02 10:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2025-12-02 10:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2025-12-02 10:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2025-12-02 10:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2025-12-02 10:00:20 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2025-12-02 10:00:20 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2025-12-02 10:00:20 [scrapy.core.engine] INFO: Spider opened
2025-12-02 10:00:20 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-12-02 10:00:20 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2025-12-02 10:00:20 [scrapy-playwright] INFO: Starting download handler
2025-12-02 10:00:20 [scrapy-playwright] INFO: Starting download handler
2025-12-02 10:00:25 [scrapy-playwright] INFO: Launching browser firefox
2025-12-02 10:00:26 [scrapy-playwright] INFO: Browser firefox launched
2025-12-02 10:00:26 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2025-12-02 10:00:27 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2025-12-02 10:00:27 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/> (resource type: document)
2025-12-02 10:00:27 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://www.manheim.co.uk/>
2025-12-02 10:00:27 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/> (resource type: document)
2025-12-02 10:00:28 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/>
2025-12-02 10:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1> (resource type: stylesheet, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/bundles/delete/scripts/homepage?v=CIpuZXIp0V7i0j1sjTB9sUemSg9-D9w8k891UP0sReI1> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:28 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en>
2025-12-02 10:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:28 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en>
2025-12-02 10:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:28 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960>
2025-12-02 10:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:28 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960>
2025-12-02 10:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:28 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960>
2025-12-02 10:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:28 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-02 10:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:28 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1>
2025-12-02 10:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-02 10:00:28 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/bundles/delete/scripts/homepage?v=CIpuZXIp0V7i0j1sjTB9sUemSg9-D9w8k891UP0sReI1>
2025-12-02 10:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/core-blessed1.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-02 10:00:28 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js>
2025-12-02 10:00:28 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js>
2025-12-02 10:00:28 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css>
2025-12-02 10:00:28 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/core-blessed1.min.css>
2025-12-02 10:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en>
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en>
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960>
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960>
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960>
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/filters/dot_pattern.png> (resource type: image, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/filters/dot_pattern.png>
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png> (resource type: image, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png>
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H>
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.manheim.co.uk/Account/IsCookieExist> (resource type: xhr, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/buying-options/buying-options-c153-treated--hero.ashx?la=en&mw=1920> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/buying-options/buying-options-c153-treated--hero.ashx?la=en&mw=1920>
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/manheimcolchester10.ashx?la=en&mw=1920> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/manheimcolchester10.ashx?la=en&mw=1920>
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-8665-treated--hero.ashx?la=en&mw=1920> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-8665-treated--hero.ashx?la=en&mw=1920>
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff>
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Account/IsCookieExist>
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff>
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff>
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff>
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/pd.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-02 10:00:31 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/pd.js>
2025-12-02 10:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/analytics?ver=3&visitor_id=&visitor_id_sign=&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:31 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/analytics?ver=3&visitor_id=&visitor_id_sign=&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=>
2025-12-02 10:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=918405288&visitor_id_sign=db7de932dfb1ec802b620169e53ed24f462268196d43832f70c5c80091efb0db94cbd2abd86e309f2a7141d9b7c6645323a3578d&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:32 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=918405288&visitor_id_sign=db7de932dfb1ec802b620169e53ed24f462268196d43832f70c5c80091efb0db94cbd2abd86e309f2a7141d9b7c6645323a3578d&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=>
2025-12-02 10:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.manheim.co.uk/account/login> (resource type: document, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <302 https://www.manheim.co.uk/account/login> (location: /mymanheim/dashboard)
2025-12-02 10:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/mymanheim/dashboard> (resource type: document, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/mymanheim/dashboard>
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1> (resource type: stylesheet, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/bundles/delete/scripts/postlogin?v=Bwe963dGqUB3Sdny8E3tKSL2gV9GDgLwX1g6Gq6KF-A1> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/SignalR/Hubs> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en>
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/jquery-ui-1.12.1.js> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Content/myManheim.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/bundles/simulcast?v=P7s0oLmuXc3p3WQNs8URnZ4NaK3K6qkWLOwf0uOs5gw1> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Content/dashboards.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en>
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1>
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1>
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en>
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en>
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en>
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en>
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en>
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en>
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1>
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/core-blessed1.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/bundles/delete/scripts/postlogin?v=Bwe963dGqUB3Sdny8E3tKSL2gV9GDgLwX1g6Gq6KF-A1>
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/SignalR/Hubs>
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Content/dashboards.css>
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Content/myManheim.css>
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/bundles/simulcast?v=P7s0oLmuXc3p3WQNs8URnZ4NaK3K6qkWLOwf0uOs5gw1>
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <302 https://www.manheim.co.uk/Scripts/jquery-ui-1.12.1.js> (location: https://www.manheim.co.uk/404)
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/404> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js>
2025-12-02 10:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js>
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css>
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/core-blessed1.min.css>
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <404 https://www.manheim.co.uk/404>
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en>
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en>
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1>
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1>
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en>
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en>
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en>
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en>
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en>
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en>
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png> (resource type: image, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png>
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/thickbox/loadingAnimation.gif> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/thickbox/loadingAnimation.gif>
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.manheim.co.uk/Account/IsCookieExist> (resource type: xhr, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H>
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff>
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff>
2025-12-02 10:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff>
2025-12-02 10:00:45 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff>
2025-12-02 10:00:45 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Account/IsCookieExist>
2025-12-02 10:00:45 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:45 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-02 10:00:45 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/pd.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:45 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:45 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-02 10:00:45 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/pd.js>
2025-12-02 10:00:45 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/analytics?ver=3&visitor_id=918405288&visitor_id_sign=db7de932dfb1ec802b620169e53ed24f462268196d43832f70c5c80091efb0db94cbd2abd86e309f2a7141d9b7c6645323a3578d&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:45 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/analytics?ver=3&visitor_id=918405288&visitor_id_sign=db7de932dfb1ec802b620169e53ed24f462268196d43832f70c5c80091efb0db94cbd2abd86e309f2a7141d9b7c6645323a3578d&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F>
2025-12-02 10:00:45 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=918405288&visitor_id_sign=db7de932dfb1ec802b620169e53ed24f462268196d43832f70c5c80091efb0db94cbd2abd86e309f2a7141d9b7c6645323a3578d&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 10:00:46 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=918405288&visitor_id_sign=db7de932dfb1ec802b620169e53ed24f462268196d43832f70c5c80091efb0db94cbd2abd86e309f2a7141d9b7c6645323a3578d&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F>
2025-12-02 10:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk> (referer: None) ['playwright']
2025-12-02 10:00:50 [manheim.gb] INFO: Cookies from Playwright: [{'name': 'ASP.NET_SessionId', 'value': 'u5vofovx0jmm0pmkget3rcbg', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': -1, 'httpOnly': True, 'secure': True, 'sameSite': 'Lax'}, {'name': '__RequestVerificationToken', 'value': '2fqIE6OqH6w6P1ZCz-GPK_G1qGCFRqkLtd7lQmHILZkj9lZMCUj5YqezedX-CiGOsVBPDVC1LW7LNHaWSM1iPKI98KE1', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': -1, 'httpOnly': True, 'secure': True, 'sameSite': 'None'}, {'name': 'cb-enabled', 'value': 'enabled', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1796205628, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'remarketing-web', 'value': '04D921023547ED6DC1B9F145548EEEAA0F70EF57845E1E928F77BB33C6B79C2C160503E93AC151514DF1284516E24F4DA3D3DC98A159E448612EDEDB0F33E1A2491BFA484ADC7E2F414279EB70105A3737ADD0D13609BBF7DD2091B30B966785D415CCFA35904C27A1B68235A7C7D9F9C7CEB904', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': -1, 'httpOnly': True, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '918405288', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1796205645, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': 'db7de932dfb1ec802b620169e53ed24f462268196d43832f70c5c80091efb0db94cbd2abd86e309f2a7141d9b7c6645323a3578d', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1796205645, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '918405288', 'domain': 'brands.coxauto.co.uk', 'path': '/', 'expires': 1796205646, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': 'db7de932dfb1ec802b620169e53ed24f462268196d43832f70c5c80091efb0db94cbd2abd86e309f2a7141d9b7c6645323a3578d', 'domain': 'brands.coxauto.co.uk', 'path': '/', 'expires': 1796205646, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '918405288', 'domain': '.pardot.com', 'path': '/', 'expires': 1796205645, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': 'db7de932dfb1ec802b620169e53ed24f462268196d43832f70c5c80091efb0db94cbd2abd86e309f2a7141d9b7c6645323a3578d', 'domain': '.pardot.com', 'path': '/', 'expires': 1796205645, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'lpv37592', 'value': 'aHR0cHM6Ly93d3cubWFuaGVpbS5jby51ay9teW1hbmhlaW0vZGFzaGJvYXJk', 'domain': 'pi.pardot.com', 'path': '/', 'expires': 1764671445, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2025-12-02 10:00:50 [manheim.gb] INFO: Scrapy-formatted cookies: [{'name': 'ASP.NET_SessionId', 'value': 'u5vofovx0jmm0pmkget3rcbg', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': '__RequestVerificationToken', 'value': '2fqIE6OqH6w6P1ZCz-GPK_G1qGCFRqkLtd7lQmHILZkj9lZMCUj5YqezedX-CiGOsVBPDVC1LW7LNHaWSM1iPKI98KE1', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'cb-enabled', 'value': 'enabled', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'remarketing-web', 'value': '04D921023547ED6DC1B9F145548EEEAA0F70EF57845E1E928F77BB33C6B79C2C160503E93AC151514DF1284516E24F4DA3D3DC98A159E448612EDEDB0F33E1A2491BFA484ADC7E2F414279EB70105A3737ADD0D13609BBF7DD2091B30B966785D415CCFA35904C27A1B68235A7C7D9F9C7CEB904', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '918405288', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': 'db7de932dfb1ec802b620169e53ed24f462268196d43832f70c5c80091efb0db94cbd2abd86e309f2a7141d9b7c6645323a3578d', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '918405288', 'domain': 'brands.coxauto.co.uk', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': 'db7de932dfb1ec802b620169e53ed24f462268196d43832f70c5c80091efb0db94cbd2abd86e309f2a7141d9b7c6645323a3578d', 'domain': 'brands.coxauto.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '918405288', 'domain': '.pardot.com', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': 'db7de932dfb1ec802b620169e53ed24f462268196d43832f70c5c80091efb0db94cbd2abd86e309f2a7141d9b7c6645323a3578d', 'domain': '.pardot.com', 'path': '/'}, {'name': 'lpv37592', 'value': 'aHR0cHM6Ly93d3cubWFuaGVpbS5jby51ay9teW1hbmhlaW0vZGFzaGJvYXJk', 'domain': 'pi.pardot.com', 'path': '/'}]
2025-12-02 10:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Manheim',RowKey='cookies') HTTP/1.1" 204 0
2025-12-02 10:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search) ['zyte-api']
2025-12-02 10:00:52 [manheim.gb] INFO: Found listing with ID: 1019262
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271019262%27 HTTP/1.1" 200 None
2025-12-02 10:00:52 [manheim.gb] INFO: Scrape type for 1019262: 0
2025-12-02 10:00:52 [manheim.gb] INFO: Found listing with ID: 1074269
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271074269%27 HTTP/1.1" 200 None
2025-12-02 10:00:52 [manheim.gb] INFO: Scrape type for 1074269: 1
2025-12-02 10:00:52 [manheim.gb] INFO: Found listing with ID: 1078284
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271078284%27 HTTP/1.1" 200 None
2025-12-02 10:00:52 [manheim.gb] INFO: Scrape type for 1078284: 2
2025-12-02 10:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:00:52 [manheim.gb] INFO: Found listing with ID: 1089633
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271089633%27 HTTP/1.1" 200 None
2025-12-02 10:00:52 [manheim.gb] INFO: Scrape type for 1089633: 0
2025-12-02 10:00:52 [manheim.gb] INFO: Found listing with ID: 1104811
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271104811%27 HTTP/1.1" 200 None
2025-12-02 10:00:52 [manheim.gb] INFO: Scrape type for 1104811: 0
2025-12-02 10:00:52 [manheim.gb] INFO: Found listing with ID: 1127441
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271127441%27 HTTP/1.1" 200 None
2025-12-02 10:00:52 [manheim.gb] INFO: Scrape type for 1127441: 0
2025-12-02 10:00:52 [manheim.gb] INFO: Found listing with ID: 1153610
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271153610%27 HTTP/1.1" 200 None
2025-12-02 10:00:52 [manheim.gb] INFO: Scrape type for 1153610: 2
2025-12-02 10:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:00:52 [manheim.gb] INFO: Found listing with ID: 1162585
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271162585%27 HTTP/1.1" 200 None
2025-12-02 10:00:52 [manheim.gb] INFO: Scrape type for 1162585: 2
2025-12-02 10:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:00:52 [manheim.gb] INFO: Found listing with ID: 1167549
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271167549%27 HTTP/1.1" 200 None
2025-12-02 10:00:52 [manheim.gb] INFO: Scrape type for 1167549: 0
2025-12-02 10:00:52 [manheim.gb] INFO: Found listing with ID: 1173100
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271173100%27 HTTP/1.1" 200 None
2025-12-02 10:00:52 [manheim.gb] INFO: Scrape type for 1173100: 0
2025-12-02 10:00:52 [manheim.gb] INFO: Found listing with ID: 1191100
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271191100%27 HTTP/1.1" 200 None
2025-12-02 10:00:52 [manheim.gb] INFO: Scrape type for 1191100: 0
2025-12-02 10:00:52 [manheim.gb] INFO: Found listing with ID: 1195824
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271195824%27 HTTP/1.1" 200 None
2025-12-02 10:00:52 [manheim.gb] INFO: Scrape type for 1195824: 0
2025-12-02 10:00:52 [manheim.gb] INFO: Found listing with ID: 124569
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27124569%27 HTTP/1.1" 200 None
2025-12-02 10:00:52 [manheim.gb] INFO: Scrape type for 124569: 0
2025-12-02 10:00:52 [manheim.gb] INFO: Found listing with ID: 1271730
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271271730%27 HTTP/1.1" 200 None
2025-12-02 10:00:52 [manheim.gb] INFO: Scrape type for 1271730: 0
2025-12-02 10:00:52 [manheim.gb] INFO: Found listing with ID: 1281726
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271281726%27 HTTP/1.1" 200 None
2025-12-02 10:00:52 [manheim.gb] INFO: Scrape type for 1281726: 0
2025-12-02 10:00:52 [manheim.gb] INFO: Found listing with ID: 1306828
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271306828%27 HTTP/1.1" 200 None
2025-12-02 10:00:52 [manheim.gb] INFO: Scrape type for 1306828: 0
2025-12-02 10:00:52 [manheim.gb] INFO: Found listing with ID: 1314291
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271314291%27 HTTP/1.1" 200 None
2025-12-02 10:00:52 [manheim.gb] INFO: Scrape type for 1314291: 0
2025-12-02 10:00:52 [manheim.gb] INFO: Found listing with ID: 1317459
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271317459%27 HTTP/1.1" 200 None
2025-12-02 10:00:52 [manheim.gb] INFO: Scrape type for 1317459: 0
2025-12-02 10:00:52 [manheim.gb] INFO: Found listing with ID: 1359028
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271359028%27 HTTP/1.1" 200 None
2025-12-02 10:00:52 [manheim.gb] INFO: Scrape type for 1359028: 0
2025-12-02 10:00:52 [manheim.gb] INFO: Found listing with ID: 1361733
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271361733%27 HTTP/1.1" 200 None
2025-12-02 10:00:52 [manheim.gb] INFO: Scrape type for 1361733: 0
2025-12-02 10:00:52 [manheim.gb] INFO: Found listing with ID: 1376686
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271376686%27 HTTP/1.1" 200 None
2025-12-02 10:00:52 [manheim.gb] INFO: Scrape type for 1376686: 1
2025-12-02 10:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:00:52 [manheim.gb] INFO: Found listing with ID: 1403363
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271403363%27 HTTP/1.1" 200 None
2025-12-02 10:00:52 [manheim.gb] INFO: Scrape type for 1403363: 0
2025-12-02 10:00:52 [manheim.gb] INFO: Found listing with ID: 1405448
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271405448%27 HTTP/1.1" 200 None
2025-12-02 10:00:52 [manheim.gb] INFO: Scrape type for 1405448: 0
2025-12-02 10:00:52 [manheim.gb] INFO: Found listing with ID: 1415800
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271415800%27 HTTP/1.1" 200 None
2025-12-02 10:00:52 [manheim.gb] INFO: Scrape type for 1415800: 1
2025-12-02 10:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:00:52 [manheim.gb] INFO: Found listing with ID: 1418917
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271418917%27 HTTP/1.1" 200 None
2025-12-02 10:00:52 [manheim.gb] INFO: Scrape type for 1418917: 0
2025-12-02 10:00:52 [manheim.gb] INFO: Found listing with ID: 1473959
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271473959%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1473959: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1479833
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271479833%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1479833: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1484153
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271484153%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1484153: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1485199
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271485199%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1485199: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 149524
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27149524%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 149524: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1501704
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271501704%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1501704: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1541191
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271541191%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1541191: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1546758
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271546758%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1546758: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1554861
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271554861%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1554861: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1563459
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271563459%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1563459: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1564349
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271564349%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1564349: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1580164
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271580164%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1580164: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1623130
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271623130%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1623130: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1639320
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271639320%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1639320: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1645141
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271645141%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1645141: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1667102
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271667102%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1667102: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1671760
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271671760%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1671760: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1691148
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271691148%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1691148: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1701386
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271701386%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1701386: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1736358
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271736358%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1736358: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1762778
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271762778%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1762778: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1783769
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271783769%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1783769: 1
2025-12-02 10:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1787313
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271787313%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1787313: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1798612
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271798612%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1798612: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1825401
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271825401%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1825401: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1835329
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271835329%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1835329: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1847472
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271847472%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1847472: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1856076
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271856076%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1856076: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1856565
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271856565%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1856565: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1859294
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271859294%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1859294: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1864706
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271864706%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1864706: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1894788
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271894788%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1894788: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1900706
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271900706%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1900706: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1905242
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271905242%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1905242: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1940423
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271940423%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1940423: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1950952
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271950952%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1950952: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1962040
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271962040%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1962040: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1989795
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271989795%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1989795: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1989821
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271989821%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1989821: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 1995165
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271995165%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 1995165: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 2014140
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272014140%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 2014140: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 2022887
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272022887%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 2022887: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 2044428
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272044428%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 2044428: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 2057516
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272057516%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 2057516: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 2058572
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272058572%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 2058572: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 2075642
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272075642%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 2075642: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 2091777
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272091777%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 2091777: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 2093385
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272093385%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 2093385: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 2143331
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272143331%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 2143331: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 2143943
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272143943%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 2143943: 1
2025-12-02 10:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 2175705
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272175705%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 2175705: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 2186514
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272186514%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 2186514: 0
2025-12-02 10:00:53 [manheim.gb] INFO: Found listing with ID: 2192411
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272192411%27 HTTP/1.1" 200 None
2025-12-02 10:00:53 [manheim.gb] INFO: Scrape type for 2192411: 0
2025-12-02 10:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=1074269&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231074269&indx=3> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21296152-fabd-5b4a-835e-16fece093cb0 with identifier: 1074269
2025-12-02 10:01:18 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 21296152-fabd-5b4a-835e-16fece093cb0
2025-12-02 10:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001074269-01987767-001.pdf> (referer: None)
2025-12-02 10:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca88cbd50>
2025-12-02 10:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 10:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_expert_report_file_15bde959-87a1-435f-9495-d184ee5e287e.pdf HTTP/1.1" 201 0
2025-12-02 10:01:20 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 21296152-fabd-5b4a-835e-16fece093cb0
2025-12-02 10:01:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21296152-fabd-5b4a-835e-16fece093cb0, skipping ID generation
2025-12-02 10:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 21296152-fabd-5b4a-835e-16fece093cb0
2025-12-02 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbe3addd-9116-4439-843d-1ca540ac40b4_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_7.jpg not downloaded yet
2025-12-02 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbe3addd-9116-4439-843d-1ca540ac40b4_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_7.jpg not downloaded yet
2025-12-02 10:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/JAGUAR/XF?id=1162585&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231162585&indx=11> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbe3addd-9116-4439-843d-1ca540ac40b4_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_6.jpg not downloaded yet
2025-12-02 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbe3addd-9116-4439-843d-1ca540ac40b4_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_1.jpg not downloaded yet
2025-12-02 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbe3addd-9116-4439-843d-1ca540ac40b4_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_5.jpg not downloaded yet
2025-12-02 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbe3addd-9116-4439-843d-1ca540ac40b4_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_4.jpg not downloaded yet
2025-12-02 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbe3addd-9116-4439-843d-1ca540ac40b4_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_11.jpg not downloaded yet
2025-12-02 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbe3addd-9116-4439-843d-1ca540ac40b4_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_10.jpg not downloaded yet
2025-12-02 10:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79c47161-bb43-5e17-bfdd-7da7029a92ba with identifier: 1162585
2025-12-02 10:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79c47161-bb43-5e17-bfdd-7da7029a92ba with scrape type 2
2025-12-02 10:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79c47161-bb43-5e17-bfdd-7da7029a92ba with scrape type 2
2025-12-02 10:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 79c47161-bb43-5e17-bfdd-7da7029a92ba, identifier: 1162585
2025-12-02 10:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbe3addd-9116-4439-843d-1ca540ac40b4_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_9.jpg not downloaded yet
2025-12-02 10:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 79c47161-bb43-5e17-bfdd-7da7029a92ba with identifier: 1162585
2025-12-02 10:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 10:01:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GREY HTTP/1.1" 200 None
2025-12-02 10:01:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 10:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 10:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 10:01:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol HTTP/1.1" 200 None
2025-12-02 10:01:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 10:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 10:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 79c47161-bb43-5e17-bfdd-7da7029a92ba with identifier: 1162585
2025-12-02 10:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 15 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
15
2025-12-02 10:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 79c47161-bb43-5e17-bfdd-7da7029a92ba spider: manheim.gb
2025-12-02 10:01:21 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 79c47161-bb43-5e17-bfdd-7da7029a92ba due to rule: registration_date_old.json, error: 15 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
15
{'auction_title': '',
'c_o_2_emission_value': 249,
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001162585-01980996-003.pdf',
'color': 'GREY',
'currency': 'GBP',
'engine': '3.0L',
'expiration_date': '2025-12-03T09:00:00Z',
'fuel_type': 'Petrol',
'id': '79c47161-bb43-5e17-bfdd-7da7029a92ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GX10XFA',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/JAGUAR/XF?id=1162585',
'listing': 'auction',
'location': 'Plymouth',
'make': 'JAGUAR',
'model': 'XF',
'odometer': 67052,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-31',
'seller_name': 'Ocean BMW',
'title': 'JAGUAR XF 3.0 V6 Luxury 4dr Auto',
'transmission': 'automatic',
'trim': '3.0 V6 Luxury 4dr Auto',
'year': 2010}
2025-12-02 10:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271162585%27 HTTP/1.1" 200 None
2025-12-02 10:01:21 [manheim.gb] INFO: Saving data for 1162585: {'auction_closing_time': 1764752400.0, 'created_time': 1763755374.114482, 'last_price_update_time': 1764669681.935456}
2025-12-02 10:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1162585') HTTP/1.1" 204 0
2025-12-02 10:01:22 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at 5 pages/min), scraped 0 items (at 0 items/min)
2025-12-02 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbe3addd-9116-4439-843d-1ca540ac40b4_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_2.jpg not downloaded yet
2025-12-02 10:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/SEAT/IBIZA?id=1415800&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231415800&indx=32> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbe3addd-9116-4439-843d-1ca540ac40b4_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_5.jpg not downloaded yet
2025-12-02 10:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001074269-01987767-001.pdf)
2025-12-02 10:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001074269-01987767-001.pdf)
2025-12-02 10:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001074269-01987767-001.pdf)
2025-12-02 10:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001074269-01987767-001.pdf)
2025-12-02 10:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001074269-01987767-001.pdf)
2025-12-02 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbe3addd-9116-4439-843d-1ca540ac40b4_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_3.jpg not downloaded yet
2025-12-02 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbe3addd-9116-4439-843d-1ca540ac40b4_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_4.jpg not downloaded yet
2025-12-02 10:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/C4CACTUS?id=1153610&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231153610&indx=10> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1074269-4004341-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-13.jpg not downloaded yet
2025-12-02 10:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27352751-c22f-5b27-9445-3e7326520c63 with identifier: 1415800
2025-12-02 10:01:22 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 27352751-c22f-5b27-9445-3e7326520c63
2025-12-02 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1074269-4004341-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1000.jpg not downloaded yet
2025-12-02 10:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6a0990>
2025-12-02 10:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_2.jpg HTTP/1.1" 201 0
2025-12-02 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbe3addd-9116-4439-843d-1ca540ac40b4_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 10:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_6.jpg saved to cache
2025-12-02 10:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 21296152-fabd-5b4a-835e-16fece093cb0
2025-12-02 10:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6a04d0>
2025-12-02 10:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_4.jpg HTTP/1.1" 201 0
2025-12-02 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbe3addd-9116-4439-843d-1ca540ac40b4_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_5.jpg saved to cache
2025-12-02 10:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 21296152-fabd-5b4a-835e-16fece093cb0
2025-12-02 10:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6bde50>
2025-12-02 10:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 10:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_1.jpg HTTP/1.1" 201 0
2025-12-02 10:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbe3addd-9116-4439-843d-1ca540ac40b4_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_7.jpg saved to cache
2025-12-02 10:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 21296152-fabd-5b4a-835e-16fece093cb0
2025-12-02 10:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6c4410>
2025-12-02 10:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_0.jpg HTTP/1.1" 201 0
2025-12-02 10:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbe3addd-9116-4439-843d-1ca540ac40b4_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_7.jpg saved to cache
2025-12-02 10:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21296152-fabd-5b4a-835e-16fece093cb0
2025-12-02 10:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6be810>
2025-12-02 10:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_3.jpg HTTP/1.1" 201 0
2025-12-02 10:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbe3addd-9116-4439-843d-1ca540ac40b4_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 10:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_1.jpg saved to cache
2025-12-02 10:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 21296152-fabd-5b4a-835e-16fece093cb0
2025-12-02 10:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1074269-4004341-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1001.jpg not downloaded yet
2025-12-02 10:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001074269-01987767-001.pdf)
2025-12-02 10:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1074269-4004341-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1002.jpg not downloaded yet
2025-12-02 10:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search) ['zyte-api']
2025-12-02 10:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001074269-01987767-001.pdf)
2025-12-02 10:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1074269-4004341-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1003.jpg not downloaded yet
2025-12-02 10:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f47d01f0-feb9-5a54-bd44-6fbcc752274f with identifier: 1153610
2025-12-02 10:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f47d01f0-feb9-5a54-bd44-6fbcc752274f with scrape type 2
2025-12-02 10:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f47d01f0-feb9-5a54-bd44-6fbcc752274f with scrape type 2
2025-12-02 10:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f47d01f0-feb9-5a54-bd44-6fbcc752274f, identifier: 1153610
2025-12-02 10:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001074269-01987767-001.pdf)
2025-12-02 10:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001074269-01987767-001.pdf)
2025-12-02 10:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f47d01f0-feb9-5a54-bd44-6fbcc752274f with identifier: 1153610
2025-12-02 10:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 10:01:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=WHITE HTTP/1.1" 200 None
2025-12-02 10:01:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 10:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 10:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f47d01f0-feb9-5a54-bd44-6fbcc752274f with identifier: 1153610
2025-12-02 10:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f47d01f0-feb9-5a54-bd44-6fbcc752274f with identifier: 1153610 to the API
2025-12-02 10:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 10:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 10:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/CITROEN/C4CACTUS?id=1153610&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231153610&indx=10>
{'auction_title': '',
'c_o_2_emission_value': 107,
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001153610-01979357-004.pdf',
'color': 'WHITE',
'currency': 'GBP',
'engine': '1.2L',
'expiration_date': '2025-12-04T09:00:00Z',
'fuel_type': 'Petrol',
'id': 'f47d01f0-feb9-5a54-bd44-6fbcc752274f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YW65FVD',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C4%20CACTUS?id=1153610',
'listing': 'auction',
'location': 'Colchester',
'make': 'CITROEN',
'model': 'C4 CACTUS',
'odometer': 67906,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-05',
'seller_name': 'John Banks',
'title': 'CITROEN C4 CACTUS 1.2 PureTech [82] Flair 5dr',
'transmission': 'manual',
'trim': '1.2 PureTech [82] Flair 5dr',
'year': 2016}
2025-12-02 10:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271153610%27 HTTP/1.1" 200 None
2025-12-02 10:01:24 [manheim.gb] INFO: Saving data for 1153610: {'auction_closing_time': 1764838800.0, 'created_time': 1764014993.216472, 'last_price_update_time': 1764669684.958154}
2025-12-02 10:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1153610') HTTP/1.1" 204 0
2025-12-02 10:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1074269-4004341-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1004.jpg not downloaded yet
2025-12-02 10:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001074269-01987767-001.pdf)
2025-12-02 10:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1074269-4004341-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1005.jpg not downloaded yet
2025-12-02 10:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca91fafd0>
2025-12-02 10:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_6.jpg HTTP/1.1" 201 0
2025-12-02 10:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbe3addd-9116-4439-843d-1ca540ac40b4_11.jpg') HTTP/1.1" 204 0
2025-12-02 10:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_11.jpg saved to cache
2025-12-02 10:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 21296152-fabd-5b4a-835e-16fece093cb0
2025-12-02 10:01:25 [manheim.gb] INFO: Found listing with ID: 2195912
2025-12-02 10:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272195912%27 HTTP/1.1" 200 None
2025-12-02 10:01:25 [manheim.gb] INFO: Scrape type for 2195912: 0
2025-12-02 10:01:25 [manheim.gb] INFO: Found listing with ID: 2237239
2025-12-02 10:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272237239%27 HTTP/1.1" 200 None
2025-12-02 10:01:25 [manheim.gb] INFO: Scrape type for 2237239: 0
2025-12-02 10:01:25 [manheim.gb] INFO: Found listing with ID: 2240054
2025-12-02 10:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272240054%27 HTTP/1.1" 200 None
2025-12-02 10:01:25 [manheim.gb] INFO: Scrape type for 2240054: 0
2025-12-02 10:01:25 [manheim.gb] INFO: Found listing with ID: 2243807
2025-12-02 10:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272243807%27 HTTP/1.1" 200 None
2025-12-02 10:01:25 [manheim.gb] INFO: Scrape type for 2243807: 0
2025-12-02 10:01:25 [manheim.gb] INFO: Found listing with ID: 2252704
2025-12-02 10:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272252704%27 HTTP/1.1" 200 None
2025-12-02 10:01:25 [manheim.gb] INFO: Scrape type for 2252704: 1
2025-12-02 10:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b0a8190>
2025-12-02 10:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_8.jpg HTTP/1.1" 201 0
2025-12-02 10:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbe3addd-9116-4439-843d-1ca540ac40b4_9.jpg') HTTP/1.1" 204 0
2025-12-02 10:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_9.jpg saved to cache
2025-12-02 10:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 21296152-fabd-5b4a-835e-16fece093cb0
2025-12-02 10:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b0a9310>
2025-12-02 10:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_9.jpg HTTP/1.1" 201 0
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbe3addd-9116-4439-843d-1ca540ac40b4_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 10:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_2.jpg saved to cache
2025-12-02 10:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 21296152-fabd-5b4a-835e-16fece093cb0
2025-12-02 10:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b0ae010>
2025-12-02 10:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_5.jpg HTTP/1.1" 201 0
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbe3addd-9116-4439-843d-1ca540ac40b4_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_4.jpg saved to cache
2025-12-02 10:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 21296152-fabd-5b4a-835e-16fece093cb0
2025-12-02 10:01:26 [manheim.gb] INFO: Found listing with ID: 2255783
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272255783%27 HTTP/1.1" 200 None
2025-12-02 10:01:26 [manheim.gb] INFO: Scrape type for 2255783: 1
2025-12-02 10:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/JAGUAR/XF?id=2143943&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232143943&indx=94> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca88fae50>
2025-12-02 10:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_7.jpg HTTP/1.1" 201 0
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbe3addd-9116-4439-843d-1ca540ac40b4_10.jpg') HTTP/1.1" 204 0
2025-12-02 10:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_10.jpg saved to cache
2025-12-02 10:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 21296152-fabd-5b4a-835e-16fece093cb0
2025-12-02 10:01:26 [manheim.gb] INFO: Found listing with ID: 2274146
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272274146%27 HTTP/1.1" 200 None
2025-12-02 10:01:26 [manheim.gb] INFO: Scrape type for 2274146: 0
2025-12-02 10:01:26 [manheim.gb] INFO: Found listing with ID: 2292927
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272292927%27 HTTP/1.1" 200 None
2025-12-02 10:01:26 [manheim.gb] INFO: Scrape type for 2292927: 0
2025-12-02 10:01:26 [manheim.gb] INFO: Found listing with ID: 2303707
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272303707%27 HTTP/1.1" 200 None
2025-12-02 10:01:26 [manheim.gb] INFO: Scrape type for 2303707: 1
2025-12-02 10:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:01:26 [manheim.gb] INFO: Found listing with ID: 2303945
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272303945%27 HTTP/1.1" 200 None
2025-12-02 10:01:26 [manheim.gb] INFO: Scrape type for 2303945: 1
2025-12-02 10:01:26 [manheim.gb] INFO: Found listing with ID: 2316345
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272316345%27 HTTP/1.1" 200 None
2025-12-02 10:01:26 [manheim.gb] INFO: Scrape type for 2316345: 1
2025-12-02 10:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c31f3c30-4a52-5772-a6f7-e4cfaf567d8b with identifier: 2143943
2025-12-02 10:01:26 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c31f3c30-4a52-5772-a6f7-e4cfaf567d8b
2025-12-02 10:01:26 [manheim.gb] INFO: Found listing with ID: 2321815
2025-12-02 10:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272321815%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2321815: 1
2025-12-02 10:01:27 [manheim.gb] INFO: Found listing with ID: 2350968
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272350968%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2350968: 0
2025-12-02 10:01:27 [manheim.gb] INFO: Found listing with ID: 2354571
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272354571%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2354571: 0
2025-12-02 10:01:27 [manheim.gb] INFO: Found listing with ID: 2358676
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272358676%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2358676: 1
2025-12-02 10:01:27 [manheim.gb] INFO: Found listing with ID: 2365471
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272365471%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2365471: 1
2025-12-02 10:01:27 [manheim.gb] INFO: Found listing with ID: 2374569
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272374569%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2374569: 0
2025-12-02 10:01:27 [manheim.gb] INFO: Found listing with ID: 2378382
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272378382%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2378382: 0
2025-12-02 10:01:27 [manheim.gb] INFO: Found listing with ID: 2383831
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272383831%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2383831: 0
2025-12-02 10:01:27 [manheim.gb] INFO: Found listing with ID: 2407950
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272407950%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2407950: 1
2025-12-02 10:01:27 [manheim.gb] INFO: Found listing with ID: 2437613
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272437613%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2437613: 0
2025-12-02 10:01:27 [manheim.gb] INFO: Found listing with ID: 2441700
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272441700%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2441700: 0
2025-12-02 10:01:27 [manheim.gb] INFO: Found listing with ID: 2452119
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272452119%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2452119: 0
2025-12-02 10:01:27 [manheim.gb] INFO: Found listing with ID: 2458076
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272458076%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2458076: 0
2025-12-02 10:01:27 [manheim.gb] INFO: Found listing with ID: 2461241
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272461241%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2461241: 0
2025-12-02 10:01:27 [manheim.gb] INFO: Found listing with ID: 2512673
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272512673%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2512673: 1
2025-12-02 10:01:27 [manheim.gb] INFO: Found listing with ID: 2531448
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272531448%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2531448: 0
2025-12-02 10:01:27 [manheim.gb] INFO: Found listing with ID: 2536974
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272536974%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2536974: 0
2025-12-02 10:01:27 [manheim.gb] INFO: Found listing with ID: 2542025
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272542025%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2542025: 0
2025-12-02 10:01:27 [manheim.gb] INFO: Found listing with ID: 2557325
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272557325%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2557325: 1
2025-12-02 10:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001074269-01987767-001.pdf)
2025-12-02 10:01:27 [manheim.gb] INFO: Found listing with ID: 2561807
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272561807%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2561807: 0
2025-12-02 10:01:27 [manheim.gb] INFO: Found listing with ID: 2565829
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272565829%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2565829: 0
2025-12-02 10:01:27 [manheim.gb] INFO: Found listing with ID: 2577653
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272577653%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2577653: 1
2025-12-02 10:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001074269-01987767-001.pdf)
2025-12-02 10:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001074269-01987767-001.pdf)
2025-12-02 10:01:27 [manheim.gb] INFO: Found listing with ID: 2589156
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272589156%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2589156: 0
2025-12-02 10:01:27 [manheim.gb] INFO: Found listing with ID: 2609055
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272609055%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2609055: 0
2025-12-02 10:01:27 [manheim.gb] INFO: Found listing with ID: 2609231
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272609231%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2609231: 0
2025-12-02 10:01:27 [manheim.gb] INFO: Found listing with ID: 2616439
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272616439%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2616439: 1
2025-12-02 10:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001074269-01987767-001.pdf)
2025-12-02 10:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001074269-01987767-001.pdf)
2025-12-02 10:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001074269-01987767-001.pdf)
2025-12-02 10:01:27 [manheim.gb] INFO: Found listing with ID: 2617226
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272617226%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2617226: 0
2025-12-02 10:01:27 [manheim.gb] INFO: Found listing with ID: 2642791
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272642791%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2642791: 1
2025-12-02 10:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001074269-01987767-001.pdf)
2025-12-02 10:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca88c3850>
2025-12-02 10:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_19.jpg HTTP/1.1" 201 0
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1074269-4004341-1005.jpg') HTTP/1.1" 204 0
2025-12-02 10:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1005.jpg saved to cache
2025-12-02 10:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 21296152-fabd-5b4a-835e-16fece093cb0
2025-12-02 10:01:27 [manheim.gb] INFO: Found listing with ID: 2643283
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272643283%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2643283: 0
2025-12-02 10:01:27 [manheim.gb] INFO: Found listing with ID: 2660446
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272660446%27 HTTP/1.1" 200 None
2025-12-02 10:01:27 [manheim.gb] INFO: Scrape type for 2660446: 1
2025-12-02 10:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001074269-01987767-001.pdf)
2025-12-02 10:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ec4390>
2025-12-02 10:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_13.jpg HTTP/1.1" 201 0
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1074269-4004341-13.jpg') HTTP/1.1" 204 0
2025-12-02 10:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-13.jpg saved to cache
2025-12-02 10:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 21296152-fabd-5b4a-835e-16fece093cb0
2025-12-02 10:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca892e1d0>
2025-12-02 10:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_17.jpg HTTP/1.1" 201 0
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1074269-4004341-1003.jpg') HTTP/1.1" 204 0
2025-12-02 10:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1003.jpg saved to cache
2025-12-02 10:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 21296152-fabd-5b4a-835e-16fece093cb0
2025-12-02 10:01:28 [manheim.gb] INFO: Found listing with ID: 2664010
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272664010%27 HTTP/1.1" 200 None
2025-12-02 10:01:28 [manheim.gb] INFO: Scrape type for 2664010: 0
2025-12-02 10:01:28 [manheim.gb] INFO: Found listing with ID: 2667513
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272667513%27 HTTP/1.1" 200 None
2025-12-02 10:01:28 [manheim.gb] INFO: Scrape type for 2667513: 0
2025-12-02 10:01:28 [manheim.gb] INFO: Found listing with ID: 2678759
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272678759%27 HTTP/1.1" 200 None
2025-12-02 10:01:28 [manheim.gb] INFO: Scrape type for 2678759: 0
2025-12-02 10:01:28 [manheim.gb] INFO: Found listing with ID: 2681410
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272681410%27 HTTP/1.1" 200 None
2025-12-02 10:01:28 [manheim.gb] INFO: Scrape type for 2681410: 0
2025-12-02 10:01:28 [manheim.gb] INFO: Found listing with ID: 2683371
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272683371%27 HTTP/1.1" 200 None
2025-12-02 10:01:28 [manheim.gb] INFO: Scrape type for 2683371: 0
2025-12-02 10:01:28 [manheim.gb] INFO: Found listing with ID: 2688065
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272688065%27 HTTP/1.1" 200 None
2025-12-02 10:01:28 [manheim.gb] INFO: Scrape type for 2688065: 0
2025-12-02 10:01:28 [manheim.gb] INFO: Found listing with ID: 2698793
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272698793%27 HTTP/1.1" 200 None
2025-12-02 10:01:28 [manheim.gb] INFO: Scrape type for 2698793: 1
2025-12-02 10:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=1783769&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231783769&indx=62> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001074269-01987767-001.pdf)
2025-12-02 10:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001074269-01987767-001.pdf)
2025-12-02 10:01:28 [manheim.gb] INFO: Found listing with ID: 2702180
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272702180%27 HTTP/1.1" 200 None
2025-12-02 10:01:28 [manheim.gb] INFO: Scrape type for 2702180: 1
2025-12-02 10:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6a0990>
2025-12-02 10:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_14.jpg HTTP/1.1" 201 0
2025-12-02 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1074269-4004341-1000.jpg') HTTP/1.1" 204 0
2025-12-02 10:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1000.jpg saved to cache
2025-12-02 10:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 21296152-fabd-5b4a-835e-16fece093cb0
2025-12-02 10:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf26410>
2025-12-02 10:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_15.jpg HTTP/1.1" 201 0
2025-12-02 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1074269-4004341-1001.jpg') HTTP/1.1" 204 0
2025-12-02 10:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1001.jpg saved to cache
2025-12-02 10:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 21296152-fabd-5b4a-835e-16fece093cb0
2025-12-02 10:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8900750>
2025-12-02 10:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_12.jpg HTTP/1.1" 201 0
2025-12-02 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbe3addd-9116-4439-843d-1ca540ac40b4_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_4.jpg saved to cache
2025-12-02 10:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 21296152-fabd-5b4a-835e-16fece093cb0
2025-12-02 10:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf732d0>
2025-12-02 10:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_16.jpg HTTP/1.1" 201 0
2025-12-02 10:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1074269-4004341-1002.jpg') HTTP/1.1" 204 0
2025-12-02 10:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1002.jpg saved to cache
2025-12-02 10:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 21296152-fabd-5b4a-835e-16fece093cb0
2025-12-02 10:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca88c2c90>
2025-12-02 10:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_18.jpg HTTP/1.1" 201 0
2025-12-02 10:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1074269-4004341-1004.jpg') HTTP/1.1" 204 0
2025-12-02 10:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1004.jpg saved to cache
2025-12-02 10:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 21296152-fabd-5b4a-835e-16fece093cb0
2025-12-02 10:01:30 [manheim.gb] INFO: Found listing with ID: 2702439
2025-12-02 10:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272702439%27 HTTP/1.1" 200 None
2025-12-02 10:01:30 [manheim.gb] INFO: Scrape type for 2702439: 0
2025-12-02 10:01:30 [manheim.gb] INFO: Found listing with ID: 2708612
2025-12-02 10:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272708612%27 HTTP/1.1" 200 None
2025-12-02 10:01:30 [manheim.gb] INFO: Scrape type for 2708612: 0
2025-12-02 10:01:30 [manheim.gb] INFO: Found listing with ID: 2727315
2025-12-02 10:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272727315%27 HTTP/1.1" 200 None
2025-12-02 10:01:30 [manheim.gb] INFO: Scrape type for 2727315: 0
2025-12-02 10:01:30 [manheim.gb] INFO: Found listing with ID: 2729252
2025-12-02 10:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272729252%27 HTTP/1.1" 200 None
2025-12-02 10:01:30 [manheim.gb] INFO: Scrape type for 2729252: 0
2025-12-02 10:01:30 [manheim.gb] INFO: Found listing with ID: 2746585
2025-12-02 10:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272746585%27 HTTP/1.1" 200 None
2025-12-02 10:01:30 [manheim.gb] INFO: Scrape type for 2746585: 0
2025-12-02 10:01:30 [manheim.gb] INFO: Found listing with ID: 2752960
2025-12-02 10:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272752960%27 HTTP/1.1" 200 None
2025-12-02 10:01:30 [manheim.gb] INFO: Scrape type for 2752960: 1
2025-12-02 10:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f with identifier: 1783769
2025-12-02 10:01:30 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f
2025-12-02 10:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8e83450>
2025-12-02 10:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 10:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_11.jpg HTTP/1.1" 201 0
2025-12-02 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbe3addd-9116-4439-843d-1ca540ac40b4_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_3.jpg saved to cache
2025-12-02 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 21296152-fabd-5b4a-835e-16fece093cb0
2025-12-02 10:01:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8da1990>
2025-12-02 10:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_10.jpg HTTP/1.1" 201 0
2025-12-02 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbe3addd-9116-4439-843d-1ca540ac40b4_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_5.jpg saved to cache
2025-12-02 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 21296152-fabd-5b4a-835e-16fece093cb0
2025-12-02 10:01:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21296152-fabd-5b4a-835e-16fece093cb0, skipping ID generation
2025-12-02 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 21296152-fabd-5b4a-835e-16fece093cb0 from tracking dictionaries
2025-12-02 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21296152-fabd-5b4a-835e-16fece093cb0 sending to next pipeline
2025-12-02 10:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 21296152-fabd-5b4a-835e-16fece093cb0, identifier: 1074269
2025-12-02 10:01:31 [manheim.gb] INFO: Found listing with ID: 2757523
2025-12-02 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272757523%27 HTTP/1.1" 200 None
2025-12-02 10:01:31 [manheim.gb] INFO: Scrape type for 2757523: 0
2025-12-02 10:01:31 [manheim.gb] INFO: Found listing with ID: 2765368
2025-12-02 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272765368%27 HTTP/1.1" 200 None
2025-12-02 10:01:31 [manheim.gb] INFO: Scrape type for 2765368: 0
2025-12-02 10:01:31 [manheim.gb] INFO: Found listing with ID: 2765752
2025-12-02 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272765752%27 HTTP/1.1" 200 None
2025-12-02 10:01:31 [manheim.gb] INFO: Scrape type for 2765752: 0
2025-12-02 10:01:31 [manheim.gb] INFO: Found listing with ID: 2767359
2025-12-02 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272767359%27 HTTP/1.1" 200 None
2025-12-02 10:01:31 [manheim.gb] INFO: Scrape type for 2767359: 0
2025-12-02 10:01:31 [manheim.gb] INFO: Found listing with ID: 2778533
2025-12-02 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272778533%27 HTTP/1.1" 200 None
2025-12-02 10:01:31 [manheim.gb] INFO: Scrape type for 2778533: 0
2025-12-02 10:01:31 [manheim.gb] INFO: Found listing with ID: 2778685
2025-12-02 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272778685%27 HTTP/1.1" 200 None
2025-12-02 10:01:31 [manheim.gb] INFO: Scrape type for 2778685: 0
2025-12-02 10:01:31 [manheim.gb] INFO: Found listing with ID: 2796740
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272796740%27 HTTP/1.1" 200 None
2025-12-02 10:01:32 [manheim.gb] INFO: Scrape type for 2796740: 0
2025-12-02 10:01:32 [manheim.gb] INFO: Found listing with ID: 2801094
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272801094%27 HTTP/1.1" 200 None
2025-12-02 10:01:32 [manheim.gb] INFO: Scrape type for 2801094: 0
2025-12-02 10:01:32 [manheim.gb] INFO: Found listing with ID: 2803271
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272803271%27 HTTP/1.1" 200 None
2025-12-02 10:01:32 [manheim.gb] INFO: Scrape type for 2803271: 0
2025-12-02 10:01:32 [manheim.gb] INFO: Found listing with ID: 2803879
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272803879%27 HTTP/1.1" 200 None
2025-12-02 10:01:32 [manheim.gb] INFO: Scrape type for 2803879: 0
2025-12-02 10:01:32 [manheim.gb] INFO: Found listing with ID: 2807133
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272807133%27 HTTP/1.1" 200 None
2025-12-02 10:01:32 [manheim.gb] INFO: Scrape type for 2807133: 0
2025-12-02 10:01:32 [manheim.gb] INFO: Found listing with ID: 2817812
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272817812%27 HTTP/1.1" 200 None
2025-12-02 10:01:32 [manheim.gb] INFO: Scrape type for 2817812: 1
2025-12-02 10:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 21296152-fabd-5b4a-835e-16fece093cb0 with identifier: 1074269
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=RED HTTP/1.1" 200 None
2025-12-02 10:01:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 10:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 21296152-fabd-5b4a-835e-16fece093cb0 with identifier: 1074269
2025-12-02 10:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 41, 'seller_name': 'vospers group', 'price_includes_vat': False, 'title': 'vauxhall corsa 1.4i 16v [100] se 5dr', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'corsa', 'transmission': 'manual', 'engine': '1.4l', 'fuel_type': 'petrol', 'odometer': 127880, 'odometer_reading_unit': 'mi', 'registration_date': '2012-02-20', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/corsa?id=1074269', 'location': 'plymouth', 'origin_country_code': 'gb', 'trim': '1.4i 16v [100] se 5dr', 'license_plate': 'dy61rze', 'year': 2012, 'listing': 'auction', 'c_o_2_emission_value': 129, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001074269-01987767-001.pdf', 'expiration_date': '2025-12-03t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '21296152-fabd-5b4a-835e-16fece093cb0', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_expert_report_file_15bde959-87a1-435f-9495-d184ee5e287e.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 216918}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 216918}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 214080}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 240321}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_5.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 212129}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_4.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 213666}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_11.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 213114}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_10.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 204978}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_9.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 212686}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 296705}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 247461}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 237434}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 288307}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 294006}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 334389}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 210030}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 362622}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 205386}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 293478}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 186898}], 'current_year_diff': 13, 'age_in_months': 165, 'make_model': 'vauxhall corsa', 'sanitized_make': 'vauxhall', 'odometer_in_km': 205802}
Failed validating None in schema:
False
On instance:
{'age_in_months': 165,
'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_expert_report_file_15bde959-87a1-435f-9495-d184ee5e287e.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001074269-01987767-001.pdf',
'color': 'red',
'currency': 'gbp',
'current_year_diff': 13,
'engine': '1.4l',
'expiration_date': '2025-12-03t09:00:00z',
'fuel_type': 'petrol',
'id': '21296152-fabd-5b4a-835e-16fece093cb0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'dy61rze',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/corsa?id=1074269',
'listing': 'auction',
'location': 'plymouth',
'make': 'vauxhall',
'make_model': 'vauxhall corsa',
'model': 'corsa',
'odometer': 127880,
'odometer_in_km': 205802,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 41,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216918,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216918,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214080,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 240321,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212129,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 213666,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 213114,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204978,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212686,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296705,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 247461,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237434,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288307,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294006,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334389,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210030,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362622,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 205386,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293478,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186898,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-20',
'sanitized_make': 'vauxhall',
'seller_name': 'vospers group',
'title': 'vauxhall corsa 1.4i 16v [100] se 5dr',
'transmission': 'manual',
'trim': '1.4i 16v [100] se 5dr',
'year': 2012}
2025-12-02 10:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 21296152-fabd-5b4a-835e-16fece093cb0 spider: manheim.gb
2025-12-02 10:01:32 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 21296152-fabd-5b4a-835e-16fece093cb0 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 41, 'seller_name': 'vospers group', 'price_includes_vat': False, 'title': 'vauxhall corsa 1.4i 16v [100] se 5dr', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'corsa', 'transmission': 'manual', 'engine': '1.4l', 'fuel_type': 'petrol', 'odometer': 127880, 'odometer_reading_unit': 'mi', 'registration_date': '2012-02-20', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/corsa?id=1074269', 'location': 'plymouth', 'origin_country_code': 'gb', 'trim': '1.4i 16v [100] se 5dr', 'license_plate': 'dy61rze', 'year': 2012, 'listing': 'auction', 'c_o_2_emission_value': 129, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001074269-01987767-001.pdf', 'expiration_date': '2025-12-03t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '21296152-fabd-5b4a-835e-16fece093cb0', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_expert_report_file_15bde959-87a1-435f-9495-d184ee5e287e.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 216918}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 216918}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 214080}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 240321}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_5.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 212129}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_4.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 213666}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_11.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 213114}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_10.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 204978}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_9.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 212686}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 296705}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 247461}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 237434}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 288307}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 294006}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 334389}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 210030}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 362622}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 205386}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 293478}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 186898}], 'current_year_diff': 13, 'age_in_months': 165, 'make_model': 'vauxhall corsa', 'sanitized_make': 'vauxhall', 'odometer_in_km': 205802}
Failed validating None in schema:
False
On instance:
{'age_in_months': 165,
'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_expert_report_file_15bde959-87a1-435f-9495-d184ee5e287e.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001074269-01987767-001.pdf',
'color': 'red',
'currency': 'gbp',
'current_year_diff': 13,
'engine': '1.4l',
'expiration_date': '2025-12-03t09:00:00z',
'fuel_type': 'petrol',
'id': '21296152-fabd-5b4a-835e-16fece093cb0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'dy61rze',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/corsa?id=1074269',
'listing': 'auction',
'location': 'plymouth',
'make': 'vauxhall',
'make_model': 'vauxhall corsa',
'model': 'corsa',
'odometer': 127880,
'odometer_in_km': 205802,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 41,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216918,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216918,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214080,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 240321,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212129,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 213666,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 213114,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204978,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212686,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296705,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 247461,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237434,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288307,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294006,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334389,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210030,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362622,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 205386,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293478,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186898,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-20',
'sanitized_make': 'vauxhall',
'seller_name': 'vospers group',
'title': 'vauxhall corsa 1.4i 16v [100] se 5dr',
'transmission': 'manual',
'trim': '1.4i 16v [100] se 5dr',
'year': 2012}
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_expert_report_file_15bde959-87a1-435f-9495-d184ee5e287e.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001074269-01987767-001.pdf',
'color': 'RED',
'currency': 'GBP',
'engine': '1.4L',
'expiration_date': '2025-12-03T09:00:00Z',
'fuel_type': 'Petrol',
'id': '21296152-fabd-5b4a-835e-16fece093cb0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DY61RZE',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=1074269',
'listing': 'auction',
'location': 'Plymouth',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 127880,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 41,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216918,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216918,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214080,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 240321,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212129,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 213666,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 213114,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204978,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212686,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296705,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 247461,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237434,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288307,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbe3addd-9116-4439-843d-1ca540ac40b4_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294006,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334389,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210030,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362622,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 205386,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293478,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21296152-fabd-5b4a-835e-16fece093cb0/21296152-fabd-5b4a-835e-16fece093cb0_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186898,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1074269-4004341-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-20',
'seller_name': 'Vospers Group',
'title': 'VAUXHALL CORSA 1.4i 16V [100] SE 5dr',
'transmission': 'manual',
'trim': '1.4i 16V [100] SE 5dr',
'year': 2012}
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271074269%27 HTTP/1.1" 200 None
2025-12-02 10:01:32 [manheim.gb] INFO: Saving data for 1074269: {'created_time': 1764669692.472021, 'last_price_update_time': 1764669692.472033, 'auction_closing_time': 1764752400.0}
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1074269') HTTP/1.1" 204 0
2025-12-02 10:01:32 [manheim.gb] INFO: Found listing with ID: 2830703
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272830703%27 HTTP/1.1" 200 None
2025-12-02 10:01:32 [manheim.gb] INFO: Scrape type for 2830703: 1
2025-12-02 10:01:32 [manheim.gb] INFO: Found listing with ID: 2837848
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272837848%27 HTTP/1.1" 200 None
2025-12-02 10:01:32 [manheim.gb] INFO: Scrape type for 2837848: 1
2025-12-02 10:01:32 [manheim.gb] INFO: Found listing with ID: 2855382
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272855382%27 HTTP/1.1" 200 None
2025-12-02 10:01:32 [manheim.gb] INFO: Scrape type for 2855382: 0
2025-12-02 10:01:32 [manheim.gb] INFO: Found listing with ID: 2863656
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272863656%27 HTTP/1.1" 200 None
2025-12-02 10:01:32 [manheim.gb] INFO: Scrape type for 2863656: 0
2025-12-02 10:01:32 [manheim.gb] INFO: Found listing with ID: 2865180
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272865180%27 HTTP/1.1" 200 None
2025-12-02 10:01:32 [manheim.gb] INFO: Scrape type for 2865180: 0
2025-12-02 10:01:32 [manheim.gb] INFO: Found listing with ID: 2869340
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272869340%27 HTTP/1.1" 200 None
2025-12-02 10:01:32 [manheim.gb] INFO: Scrape type for 2869340: 0
2025-12-02 10:01:32 [manheim.gb] INFO: Found listing with ID: 2871207
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272871207%27 HTTP/1.1" 200 None
2025-12-02 10:01:32 [manheim.gb] INFO: Scrape type for 2871207: 0
2025-12-02 10:01:32 [manheim.gb] INFO: Found listing with ID: 2876443
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272876443%27 HTTP/1.1" 200 None
2025-12-02 10:01:32 [manheim.gb] INFO: Scrape type for 2876443: 1
2025-12-02 10:01:32 [manheim.gb] INFO: Found listing with ID: 2884710
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272884710%27 HTTP/1.1" 200 None
2025-12-02 10:01:32 [manheim.gb] INFO: Scrape type for 2884710: 0
2025-12-02 10:01:32 [manheim.gb] INFO: Found listing with ID: 2886723
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272886723%27 HTTP/1.1" 200 None
2025-12-02 10:01:32 [manheim.gb] INFO: Scrape type for 2886723: 0
2025-12-02 10:01:32 [manheim.gb] INFO: Found listing with ID: 2890185
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272890185%27 HTTP/1.1" 200 None
2025-12-02 10:01:32 [manheim.gb] INFO: Scrape type for 2890185: 0
2025-12-02 10:01:32 [manheim.gb] INFO: Found listing with ID: 2893691
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272893691%27 HTTP/1.1" 200 None
2025-12-02 10:01:32 [manheim.gb] INFO: Scrape type for 2893691: 0
2025-12-02 10:01:32 [manheim.gb] INFO: Found listing with ID: 2896151
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272896151%27 HTTP/1.1" 200 None
2025-12-02 10:01:32 [manheim.gb] INFO: Scrape type for 2896151: 0
2025-12-02 10:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001415800-01976295-002.pdf> (referer: None)
2025-12-02 10:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6edf50>
2025-12-02 10:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_expert_report_file_81a4328e-ba38-48a0-bdad-d85ce958d2b6.pdf HTTP/1.1" 201 0
2025-12-02 10:01:33 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 27352751-c22f-5b27-9445-3e7326520c63
2025-12-02 10:01:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27352751-c22f-5b27-9445-3e7326520c63, skipping ID generation
2025-12-02 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 27352751-c22f-5b27-9445-3e7326520c63
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1415800-9999999-329091548-004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-004.jpg already downloaded
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1415800-9999999-329091548-008.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-008.jpg already downloaded
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1415800-9999999-329091548-001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-001.jpg already downloaded
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1415800-9999999-329091548-002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-002.jpg already downloaded
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1415800-9999999-329091548-003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-003.jpg already downloaded
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1415800-9999999-329091548-005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-005.jpg already downloaded
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1415800-9999999-329091548-006.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-006.jpg already downloaded
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1415800-9999999-329091548-007.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-007.jpg already downloaded
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1415800-9999999-329091548-009.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-009.jpg already downloaded
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1415800-9999999-329091548-010.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-010.jpg already downloaded
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1415800-9999999-329091548-011.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-011.jpg already downloaded
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1415800-9999999-329091548-012.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-012.jpg already downloaded
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1415800-3996172-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-13.jpg already downloaded
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1415800-3996172-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1000.jpg already downloaded
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1415800-3996172-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1001.jpg already downloaded
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1415800-3996172-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1002.jpg already downloaded
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1415800-3996172-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1003.jpg already downloaded
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1415800-3996172-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1004.jpg already downloaded
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1415800-3996172-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1005.jpg already downloaded
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1415800-3996172-1006.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1006.jpg already downloaded
2025-12-02 10:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 27352751-c22f-5b27-9445-3e7326520c63, identifier: 1415800
2025-12-02 10:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 27352751-c22f-5b27-9445-3e7326520c63 with identifier: 1415800
2025-12-02 10:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 27352751-c22f-5b27-9445-3e7326520c63 with identifier: 1415800
2025-12-02 10:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 27, 'seller_name': None, 'price_includes_vat': False, 'title': 'seat ibiza 1.4 sportrider 3dr', 'price': 0, 'currency': 'gbp', 'make': 'seat', 'model': 'ibiza', 'transmission': 'manual', 'engine': '1.4l', 'fuel_type': 'petrol', 'odometer': 129537, 'odometer_reading_unit': 'mi', 'registration_date': '2011-09-03', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/seat/ibiza?id=1415800', 'location': 'washington - in transit', 'origin_country_code': 'gb', 'trim': '1.4 sportrider 3dr', 'license_plate': 'nj61tzt', 'year': 2011, 'listing': 'auction', 'c_o_2_emission_value': 139, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001415800-01976295-002.pdf', 'expiration_date': '2025-12-03t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-004.jpg', 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-008.jpg', 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-001.jpg', 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-002.jpg', 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-003.jpg', 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-005.jpg', 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-006.jpg', 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-007.jpg', 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-009.jpg', 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-010.jpg', 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-011.jpg', 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-012.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-13.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1000.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1001.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1002.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1003.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1004.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1005.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1006.jpg'], 'id': '27352751-c22f-5b27-9445-3e7326520c63', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_expert_report_file_81a4328e-ba38-48a0-bdad-d85ce958d2b6.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 288059}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-008.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 245029}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 227448}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 285755}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 247042}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 300607}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-006.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 239582}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-007.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 255380}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-009.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 265182}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-010.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 157273}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-011.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 184619}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-012.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 227207}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-13.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 394716}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1000.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 332341}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1001.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 387498}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1002.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 283255}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1003.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 292438}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1004.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 293451}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1005.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 298044}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1006.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 214283}], 'current_year_diff': 14, 'age_in_months': 170, 'make_model': 'seat ibiza', 'sanitized_make': 'seat', 'odometer_in_km': 208469}
Failed validating None in schema:
False
On instance:
{'age_in_months': 170,
'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_expert_report_file_81a4328e-ba38-48a0-bdad-d85ce958d2b6.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001415800-01976295-002.pdf',
'color': 'grey',
'currency': 'gbp',
'current_year_diff': 14,
'engine': '1.4l',
'expiration_date': '2025-12-03t09:00:00z',
'fuel_type': 'petrol',
'id': '27352751-c22f-5b27-9445-3e7326520c63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'nj61tzt',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/seat/ibiza?id=1415800',
'listing': 'auction',
'location': 'washington - in transit',
'make': 'seat',
'make_model': 'seat ibiza',
'model': 'ibiza',
'odometer': 129537,
'odometer_in_km': 208469,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 27,
'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-004.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-008.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-001.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-002.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-003.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-005.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-006.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-007.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-009.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-010.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-011.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-012.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-13.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1000.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1001.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1002.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1003.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1004.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1005.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1006.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288059,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245029,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-008.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 227448,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285755,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 247042,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300607,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-005.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239582,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-006.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 255380,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-007.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 265182,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-009.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 157273,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-010.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184619,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-011.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 227207,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-012.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394716,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-13.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332341,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1000.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387498,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1001.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283255,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1002.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292438,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1003.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293451,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1004.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298044,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1005.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214283,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1006.jpg',
'Width': 1500}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-03',
'sanitized_make': 'seat',
'seller_name': None,
'title': 'seat ibiza 1.4 sportrider 3dr',
'transmission': 'manual',
'trim': '1.4 sportrider 3dr',
'year': 2011}
2025-12-02 10:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 27352751-c22f-5b27-9445-3e7326520c63 spider: manheim.gb
2025-12-02 10:01:34 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 27352751-c22f-5b27-9445-3e7326520c63 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 27, 'seller_name': None, 'price_includes_vat': False, 'title': 'seat ibiza 1.4 sportrider 3dr', 'price': 0, 'currency': 'gbp', 'make': 'seat', 'model': 'ibiza', 'transmission': 'manual', 'engine': '1.4l', 'fuel_type': 'petrol', 'odometer': 129537, 'odometer_reading_unit': 'mi', 'registration_date': '2011-09-03', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/seat/ibiza?id=1415800', 'location': 'washington - in transit', 'origin_country_code': 'gb', 'trim': '1.4 sportrider 3dr', 'license_plate': 'nj61tzt', 'year': 2011, 'listing': 'auction', 'c_o_2_emission_value': 139, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001415800-01976295-002.pdf', 'expiration_date': '2025-12-03t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-004.jpg', 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-008.jpg', 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-001.jpg', 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-002.jpg', 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-003.jpg', 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-005.jpg', 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-006.jpg', 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-007.jpg', 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-009.jpg', 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-010.jpg', 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-011.jpg', 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-012.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-13.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1000.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1001.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1002.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1003.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1004.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1005.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1006.jpg'], 'id': '27352751-c22f-5b27-9445-3e7326520c63', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_expert_report_file_81a4328e-ba38-48a0-bdad-d85ce958d2b6.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 288059}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-008.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 245029}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 227448}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 285755}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 247042}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 300607}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-006.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 239582}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-007.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 255380}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-009.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 265182}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-010.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 157273}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-011.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 184619}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-012.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 227207}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-13.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 394716}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1000.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 332341}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1001.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 387498}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1002.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 283255}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1003.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 292438}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1004.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 293451}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1005.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 298044}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1006.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 214283}], 'current_year_diff': 14, 'age_in_months': 170, 'make_model': 'seat ibiza', 'sanitized_make': 'seat', 'odometer_in_km': 208469}
Failed validating None in schema:
False
On instance:
{'age_in_months': 170,
'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_expert_report_file_81a4328e-ba38-48a0-bdad-d85ce958d2b6.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001415800-01976295-002.pdf',
'color': 'grey',
'currency': 'gbp',
'current_year_diff': 14,
'engine': '1.4l',
'expiration_date': '2025-12-03t09:00:00z',
'fuel_type': 'petrol',
'id': '27352751-c22f-5b27-9445-3e7326520c63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'nj61tzt',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/seat/ibiza?id=1415800',
'listing': 'auction',
'location': 'washington - in transit',
'make': 'seat',
'make_model': 'seat ibiza',
'model': 'ibiza',
'odometer': 129537,
'odometer_in_km': 208469,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 27,
'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-004.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-008.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-001.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-002.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-003.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-005.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-006.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-007.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-009.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-010.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-011.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-012.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-13.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1000.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1001.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1002.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1003.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1004.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1005.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1006.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288059,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245029,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-008.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 227448,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285755,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 247042,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300607,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-005.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239582,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-006.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 255380,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-007.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 265182,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-009.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 157273,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-010.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184619,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-011.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 227207,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-012.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394716,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-13.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332341,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1000.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387498,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1001.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283255,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1002.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292438,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1003.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293451,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1004.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298044,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1005.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214283,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1006.jpg',
'Width': 1500}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-03',
'sanitized_make': 'seat',
'seller_name': None,
'title': 'seat ibiza 1.4 sportrider 3dr',
'transmission': 'manual',
'trim': '1.4 sportrider 3dr',
'year': 2011}
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_expert_report_file_81a4328e-ba38-48a0-bdad-d85ce958d2b6.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001415800-01976295-002.pdf',
'color': 'GREY',
'currency': 'GBP',
'engine': '1.4L',
'expiration_date': '2025-12-03T09:00:00Z',
'fuel_type': 'Petrol',
'id': '27352751-c22f-5b27-9445-3e7326520c63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NJ61TZT',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/SEAT/IBIZA?id=1415800',
'listing': 'auction',
'location': 'Washington - In Transit',
'make': 'SEAT',
'model': 'IBIZA',
'odometer': 129537,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-004.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-008.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-001.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-002.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-003.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-005.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-006.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-007.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-009.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-010.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-011.jpg',
'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-012.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-13.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1000.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1001.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1002.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1003.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1004.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1005.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1006.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288059,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245029,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-008.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 227448,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285755,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 247042,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300607,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-005.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239582,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-006.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 255380,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-007.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 265182,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-009.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 157273,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-010.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184619,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-011.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 227207,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1415800-9999999-329091548-012.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394716,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-13.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332341,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1000.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387498,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1001.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283255,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1002.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292438,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1003.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293451,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1004.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298044,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1005.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27352751-c22f-5b27-9445-3e7326520c63/27352751-c22f-5b27-9445-3e7326520c63_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214283,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1415800-3996172-1006.jpg',
'Width': 1500}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-03',
'seller_name': None,
'title': 'SEAT IBIZA 1.4 Sportrider 3dr',
'transmission': 'manual',
'trim': '1.4 Sportrider 3dr',
'year': 2011}
2025-12-02 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271415800%27 HTTP/1.1" 200 None
2025-12-02 10:01:34 [manheim.gb] INFO: Saving data for 1415800: {'created_time': 1764669694.179818, 'last_price_update_time': 1764669694.179832, 'auction_closing_time': 1764752400.0}
2025-12-02 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1415800') HTTP/1.1" 204 0
2025-12-02 10:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MAZDA/CX5?id=1376686&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231376686&indx=28> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f8d1df0-3667-5cb5-beba-c9437681bc85 with identifier: 1376686
2025-12-02 10:01:42 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4f8d1df0-3667-5cb5-beba-c9437681bc85
2025-12-02 10:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/C4GRANDSPACETOURER?id=2255783&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232255783&indx=108> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1636bef3-09f3-50b8-8ff7-dc154055d704 with identifier: 2255783
2025-12-02 10:01:52 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1636bef3-09f3-50b8-8ff7-dc154055d704
2025-12-02 10:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001376686-01914162-005.pdf> (referer: None)
2025-12-02 10:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf7d850>
2025-12-02 10:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f8d1df0-3667-5cb5-beba-c9437681bc85/4f8d1df0-3667-5cb5-beba-c9437681bc85_expert_report_file_8f83ec01-e305-4f23-b1f8-9fde8650e3e9.pdf HTTP/1.1" 201 0
2025-12-02 10:01:53 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4f8d1df0-3667-5cb5-beba-c9437681bc85
2025-12-02 10:01:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f8d1df0-3667-5cb5-beba-c9437681bc85, skipping ID generation
2025-12-02 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 4f8d1df0-3667-5cb5-beba-c9437681bc85
2025-12-02 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8555a676-d010-4ee6-96d9-d787b6eae098_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_ext_7.jpg already downloaded
2025-12-02 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8555a676-d010-4ee6-96d9-d787b6eae098_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_ext_7.jpg already downloaded
2025-12-02 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8555a676-d010-4ee6-96d9-d787b6eae098_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_ext_6.jpg already downloaded
2025-12-02 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8555a676-d010-4ee6-96d9-d787b6eae098_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_ext_1.jpg already downloaded
2025-12-02 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8555a676-d010-4ee6-96d9-d787b6eae098_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_5.jpg already downloaded
2025-12-02 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8555a676-d010-4ee6-96d9-d787b6eae098_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_4.jpg already downloaded
2025-12-02 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8555a676-d010-4ee6-96d9-d787b6eae098_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_11.jpg already downloaded
2025-12-02 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8555a676-d010-4ee6-96d9-d787b6eae098_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_10.jpg already downloaded
2025-12-02 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8555a676-d010-4ee6-96d9-d787b6eae098_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_9.jpg already downloaded
2025-12-02 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8555a676-d010-4ee6-96d9-d787b6eae098_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_ext_2.jpg already downloaded
2025-12-02 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8555a676-d010-4ee6-96d9-d787b6eae098_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_ext_5.jpg already downloaded
2025-12-02 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8555a676-d010-4ee6-96d9-d787b6eae098_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_ext_3.jpg already downloaded
2025-12-02 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8555a676-d010-4ee6-96d9-d787b6eae098_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_ext_4.jpg already downloaded
2025-12-02 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1376686-3914438-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1376686-3914438-13.jpg already downloaded
2025-12-02 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1376686-3914438-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1376686-3914438-1000.jpg already downloaded
2025-12-02 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1376686-3914438-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1376686-3914438-1001.jpg already downloaded
2025-12-02 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1376686-3914438-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1376686-3914438-1002.jpg already downloaded
2025-12-02 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1376686-3914438-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1376686-3914438-1003.jpg already downloaded
2025-12-02 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1376686-3914438-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1376686-3914438-1004.jpg already downloaded
2025-12-02 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1376686-3914438-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1376686-3914438-1005.jpg already downloaded
2025-12-02 10:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 4f8d1df0-3667-5cb5-beba-c9437681bc85, identifier: 1376686
2025-12-02 10:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 4f8d1df0-3667-5cb5-beba-c9437681bc85 with identifier: 1376686
2025-12-02 10:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 10:01:54 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLACK HTTP/1.1" 200 None
2025-12-02 10:01:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 10:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 4f8d1df0-3667-5cb5-beba-c9437681bc85 with identifier: 1376686
2025-12-02 10:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 190964 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
190964
2025-12-02 10:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 4f8d1df0-3667-5cb5-beba-c9437681bc85 spider: manheim.gb
2025-12-02 10:01:54 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 4f8d1df0-3667-5cb5-beba-c9437681bc85 due to rule: high_mileage_for_country.json, error: 190964 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
190964
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8d1df0-3667-5cb5-beba-c9437681bc85/4f8d1df0-3667-5cb5-beba-c9437681bc85_expert_report_file_8f83ec01-e305-4f23-b1f8-9fde8650e3e9.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001376686-01914162-005.pdf',
'color': 'BLACK',
'currency': 'GBP',
'engine': '2.0L',
'expiration_date': '2025-12-04T09:00:00Z',
'fuel_type': 'Petrol',
'id': '4f8d1df0-3667-5cb5-beba-c9437681bc85',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PJ63BVD',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MAZDA/CX-5?id=1376686',
'listing': 'auction',
'location': 'Bristol',
'make': 'MAZDA',
'model': 'CX-5',
'odometer': 118660,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 56,
'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_ext_7.jpg',
'http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_ext_7.jpg',
'http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_ext_6.jpg',
'http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_ext_1.jpg',
'http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_5.jpg',
'http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_4.jpg',
'http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_11.jpg',
'http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_10.jpg',
'http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_9.jpg',
'http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_ext_2.jpg',
'http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_ext_5.jpg',
'http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_ext_3.jpg',
'http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_ext_4.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1376686-3914438-13.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1376686-3914438-1000.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1376686-3914438-1001.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1376686-3914438-1002.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1376686-3914438-1003.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1376686-3914438-1004.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1376686-3914438-1005.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8d1df0-3667-5cb5-beba-c9437681bc85/4f8d1df0-3667-5cb5-beba-c9437681bc85_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252904,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8d1df0-3667-5cb5-beba-c9437681bc85/4f8d1df0-3667-5cb5-beba-c9437681bc85_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252904,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8d1df0-3667-5cb5-beba-c9437681bc85/4f8d1df0-3667-5cb5-beba-c9437681bc85_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285602,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8d1df0-3667-5cb5-beba-c9437681bc85/4f8d1df0-3667-5cb5-beba-c9437681bc85_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 203397,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8d1df0-3667-5cb5-beba-c9437681bc85/4f8d1df0-3667-5cb5-beba-c9437681bc85_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 241828,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8d1df0-3667-5cb5-beba-c9437681bc85/4f8d1df0-3667-5cb5-beba-c9437681bc85_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245941,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8d1df0-3667-5cb5-beba-c9437681bc85/4f8d1df0-3667-5cb5-beba-c9437681bc85_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 243722,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8d1df0-3667-5cb5-beba-c9437681bc85/4f8d1df0-3667-5cb5-beba-c9437681bc85_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 231450,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8d1df0-3667-5cb5-beba-c9437681bc85/4f8d1df0-3667-5cb5-beba-c9437681bc85_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252917,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8d1df0-3667-5cb5-beba-c9437681bc85/4f8d1df0-3667-5cb5-beba-c9437681bc85_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285335,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8d1df0-3667-5cb5-beba-c9437681bc85/4f8d1df0-3667-5cb5-beba-c9437681bc85_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304930,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8d1df0-3667-5cb5-beba-c9437681bc85/4f8d1df0-3667-5cb5-beba-c9437681bc85_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263753,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8d1df0-3667-5cb5-beba-c9437681bc85/4f8d1df0-3667-5cb5-beba-c9437681bc85_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 238814,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8555a676-d010-4ee6-96d9-d787b6eae098_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8d1df0-3667-5cb5-beba-c9437681bc85/4f8d1df0-3667-5cb5-beba-c9437681bc85_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 174610,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1376686-3914438-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8d1df0-3667-5cb5-beba-c9437681bc85/4f8d1df0-3667-5cb5-beba-c9437681bc85_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 173635,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1376686-3914438-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8d1df0-3667-5cb5-beba-c9437681bc85/4f8d1df0-3667-5cb5-beba-c9437681bc85_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212866,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1376686-3914438-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8d1df0-3667-5cb5-beba-c9437681bc85/4f8d1df0-3667-5cb5-beba-c9437681bc85_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192650,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1376686-3914438-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8d1df0-3667-5cb5-beba-c9437681bc85/4f8d1df0-3667-5cb5-beba-c9437681bc85_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263453,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1376686-3914438-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8d1df0-3667-5cb5-beba-c9437681bc85/4f8d1df0-3667-5cb5-beba-c9437681bc85_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187480,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1376686-3914438-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8d1df0-3667-5cb5-beba-c9437681bc85/4f8d1df0-3667-5cb5-beba-c9437681bc85_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181265,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1376686-3914438-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-03',
'seller_name': 'Bluewater Vehicle Redistribution',
'title': 'MAZDA CX-5 2.0 Sport Nav 5dr',
'transmission': 'manual',
'trim': '2.0 Sport Nav 5dr',
'year': 2013}
2025-12-02 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271376686%27 HTTP/1.1" 200 None
2025-12-02 10:01:54 [manheim.gb] INFO: Saving data for 1376686: {'created_time': 1764669714.696571, 'last_price_update_time': 1764669714.696586, 'auction_closing_time': 1764838800.0}
2025-12-02 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1376686') HTTP/1.1" 204 0
2025-12-02 10:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/ZAFIRA?id=2557325&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232557325&indx=144> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e9d48c6-5225-5f6e-b1d5-50a6097d010b with identifier: 2557325
2025-12-02 10:01:54 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0e9d48c6-5225-5f6e-b1d5-50a6097d010b
2025-12-02 10:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002255783-01985373-002.pdf> (referer: None)
2025-12-02 10:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfcddd0>
2025-12-02 10:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_expert_report_file_a95356ae-1792-42af-9d65-f6126b1ef916.pdf HTTP/1.1" 201 0
2025-12-02 10:01:55 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1636bef3-09f3-50b8-8ff7-dc154055d704
2025-12-02 10:01:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1636bef3-09f3-50b8-8ff7-dc154055d704, skipping ID generation
2025-12-02 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 1636bef3-09f3-50b8-8ff7-dc154055d704
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b36675d-ed13-48f1-8320-ca36411bdf70_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_7.jpg not downloaded yet
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b36675d-ed13-48f1-8320-ca36411bdf70_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_7.jpg not downloaded yet
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b36675d-ed13-48f1-8320-ca36411bdf70_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_6.jpg not downloaded yet
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b36675d-ed13-48f1-8320-ca36411bdf70_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_1.jpg not downloaded yet
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b36675d-ed13-48f1-8320-ca36411bdf70_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_5.jpg not downloaded yet
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b36675d-ed13-48f1-8320-ca36411bdf70_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_4.jpg not downloaded yet
2025-12-02 10:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/108?id=2512673&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232512673&indx=137> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b36675d-ed13-48f1-8320-ca36411bdf70_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_11.jpg not downloaded yet
2025-12-02 10:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b36675d-ed13-48f1-8320-ca36411bdf70_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_10.jpg not downloaded yet
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b36675d-ed13-48f1-8320-ca36411bdf70_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_9.jpg not downloaded yet
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b36675d-ed13-48f1-8320-ca36411bdf70_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_2.jpg not downloaded yet
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b36675d-ed13-48f1-8320-ca36411bdf70_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_5.jpg not downloaded yet
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b36675d-ed13-48f1-8320-ca36411bdf70_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_3.jpg not downloaded yet
2025-12-02 10:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4 with identifier: 2512673
2025-12-02 10:01:55 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b36675d-ed13-48f1-8320-ca36411bdf70_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_4.jpg not downloaded yet
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255783-4003462-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255783-4003462-13.jpg not downloaded yet
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255783-4003462-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255783-4003462-1000.jpg not downloaded yet
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255783-4003462-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255783-4003462-1001.jpg not downloaded yet
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255783-4003462-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255783-4003462-1002.jpg not downloaded yet
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255783-4003462-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255783-4003462-1003.jpg not downloaded yet
2025-12-02 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255783-4003462-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255783-4003462-1004.jpg not downloaded yet
2025-12-02 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255783-4003462-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255783-4003462-1005.jpg not downloaded yet
2025-12-02 10:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255783-01985373-002.pdf)
2025-12-02 10:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002557325-01975145-004.pdf> (referer: None)
2025-12-02 10:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6e12d0>
2025-12-02 10:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_5.jpg HTTP/1.1" 201 0
2025-12-02 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b36675d-ed13-48f1-8320-ca36411bdf70_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_4.jpg saved to cache
2025-12-02 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1636bef3-09f3-50b8-8ff7-dc154055d704
2025-12-02 10:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2255783-4003462-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255783-01985373-002.pdf)
2025-12-02 10:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf50090>
2025-12-02 10:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e9d48c6-5225-5f6e-b1d5-50a6097d010b/0e9d48c6-5225-5f6e-b1d5-50a6097d010b_expert_report_file_01c8f55d-b526-497e-983e-b979d01a8615.pdf HTTP/1.1" 201 0
2025-12-02 10:01:56 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0e9d48c6-5225-5f6e-b1d5-50a6097d010b
2025-12-02 10:01:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e9d48c6-5225-5f6e-b1d5-50a6097d010b, skipping ID generation
2025-12-02 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 0e9d48c6-5225-5f6e-b1d5-50a6097d010b
2025-12-02 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_7.jpg already downloaded
2025-12-02 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_7.jpg already downloaded
2025-12-02 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_6.jpg already downloaded
2025-12-02 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_1.jpg already downloaded
2025-12-02 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0c0db36f-3907-494d-9b3f-4ff5a1a76a00_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_5.jpg already downloaded
2025-12-02 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0c0db36f-3907-494d-9b3f-4ff5a1a76a00_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_4.jpg already downloaded
2025-12-02 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0c0db36f-3907-494d-9b3f-4ff5a1a76a00_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_11.jpg already downloaded
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0c0db36f-3907-494d-9b3f-4ff5a1a76a00_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_10.jpg already downloaded
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0c0db36f-3907-494d-9b3f-4ff5a1a76a00_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_9.jpg already downloaded
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_2.jpg already downloaded
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_5.jpg already downloaded
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_3.jpg already downloaded
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_4.jpg already downloaded
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2557325-3991596-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2557325-3991596-13.jpg already downloaded
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2557325-3991596-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2557325-3991596-1000.jpg already downloaded
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2557325-3991596-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2557325-3991596-1001.jpg already downloaded
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2557325-3991596-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2557325-3991596-1002.jpg already downloaded
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2557325-3991596-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2557325-3991596-1003.jpg already downloaded
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2557325-3991596-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2557325-3991596-1004.jpg already downloaded
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2557325-3991596-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2557325-3991596-1005.jpg already downloaded
2025-12-02 10:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 0e9d48c6-5225-5f6e-b1d5-50a6097d010b, identifier: 2557325
2025-12-02 10:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2255783-4003462-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255783-01985373-002.pdf)
2025-12-02 10:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 0e9d48c6-5225-5f6e-b1d5-50a6097d010b with identifier: 2557325
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=White HTTP/1.1" 200 None
2025-12-02 10:01:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel HTTP/1.1" 200 None
2025-12-02 10:01:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 10:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 0e9d48c6-5225-5f6e-b1d5-50a6097d010b with identifier: 2557325
2025-12-02 10:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 0e9d48c6-5225-5f6e-b1d5-50a6097d010b with identifier: 2557325 to the API
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 10:01:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 10:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 http://ecr.manheim.co.uk/pdf/MOL-0002557325-01975145-004.pdf>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9d48c6-5225-5f6e-b1d5-50a6097d010b/0e9d48c6-5225-5f6e-b1d5-50a6097d010b_expert_report_file_01c8f55d-b526-497e-983e-b979d01a8615.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002557325-01975145-004.pdf',
'color': 'White',
'currency': 'GBP',
'engine': '2.0L',
'expiration_date': '2025-12-04T09:00:00Z',
'fuel_type': 'Diesel',
'id': '0e9d48c6-5225-5f6e-b1d5-50a6097d010b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HY66UAM',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/ZAFIRA?id=2557325',
'listing': 'auction',
'location': 'Colchester',
'make': 'VAUXHALL',
'model': 'ZAFIRA',
'odometer': 72258,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 29,
'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_7.jpg',
'http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_7.jpg',
'http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_6.jpg',
'http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_1.jpg',
'http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_5.jpg',
'http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_4.jpg',
'http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_11.jpg',
'http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_10.jpg',
'http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_9.jpg',
'http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_2.jpg',
'http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_5.jpg',
'http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_3.jpg',
'http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_4.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2557325-3991596-13.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2557325-3991596-1000.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2557325-3991596-1001.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2557325-3991596-1002.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2557325-3991596-1003.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2557325-3991596-1004.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2557325-3991596-1005.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9d48c6-5225-5f6e-b1d5-50a6097d010b/0e9d48c6-5225-5f6e-b1d5-50a6097d010b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 174754,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9d48c6-5225-5f6e-b1d5-50a6097d010b/0e9d48c6-5225-5f6e-b1d5-50a6097d010b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 174754,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9d48c6-5225-5f6e-b1d5-50a6097d010b/0e9d48c6-5225-5f6e-b1d5-50a6097d010b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 221807,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9d48c6-5225-5f6e-b1d5-50a6097d010b/0e9d48c6-5225-5f6e-b1d5-50a6097d010b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119201,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9d48c6-5225-5f6e-b1d5-50a6097d010b/0e9d48c6-5225-5f6e-b1d5-50a6097d010b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 167409,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9d48c6-5225-5f6e-b1d5-50a6097d010b/0e9d48c6-5225-5f6e-b1d5-50a6097d010b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 158478,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9d48c6-5225-5f6e-b1d5-50a6097d010b/0e9d48c6-5225-5f6e-b1d5-50a6097d010b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168738,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9d48c6-5225-5f6e-b1d5-50a6097d010b/0e9d48c6-5225-5f6e-b1d5-50a6097d010b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151785,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9d48c6-5225-5f6e-b1d5-50a6097d010b/0e9d48c6-5225-5f6e-b1d5-50a6097d010b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 165673,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9d48c6-5225-5f6e-b1d5-50a6097d010b/0e9d48c6-5225-5f6e-b1d5-50a6097d010b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 234336,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9d48c6-5225-5f6e-b1d5-50a6097d010b/0e9d48c6-5225-5f6e-b1d5-50a6097d010b_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 207803,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9d48c6-5225-5f6e-b1d5-50a6097d010b/0e9d48c6-5225-5f6e-b1d5-50a6097d010b_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 259333,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9d48c6-5225-5f6e-b1d5-50a6097d010b/0e9d48c6-5225-5f6e-b1d5-50a6097d010b_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 266224,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0c0db36f-3907-494d-9b3f-4ff5a1a76a00_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9d48c6-5225-5f6e-b1d5-50a6097d010b/0e9d48c6-5225-5f6e-b1d5-50a6097d010b_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 232908,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2557325-3991596-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9d48c6-5225-5f6e-b1d5-50a6097d010b/0e9d48c6-5225-5f6e-b1d5-50a6097d010b_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179709,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2557325-3991596-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9d48c6-5225-5f6e-b1d5-50a6097d010b/0e9d48c6-5225-5f6e-b1d5-50a6097d010b_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196834,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2557325-3991596-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9d48c6-5225-5f6e-b1d5-50a6097d010b/0e9d48c6-5225-5f6e-b1d5-50a6097d010b_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 244532,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2557325-3991596-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9d48c6-5225-5f6e-b1d5-50a6097d010b/0e9d48c6-5225-5f6e-b1d5-50a6097d010b_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344928,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2557325-3991596-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9d48c6-5225-5f6e-b1d5-50a6097d010b/0e9d48c6-5225-5f6e-b1d5-50a6097d010b_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 156393,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2557325-3991596-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e9d48c6-5225-5f6e-b1d5-50a6097d010b/0e9d48c6-5225-5f6e-b1d5-50a6097d010b_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285703,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2557325-3991596-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-26',
'seller_name': 'Big Motoring World Ltd',
'title': 'VAUXHALL ZAFIRA 2.0 CDTi SRi 5dr',
'transmission': 'manual',
'trim': '2.0 CDTi SRi 5dr',
'year': 2016}
2025-12-02 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272557325%27 HTTP/1.1" 200 None
2025-12-02 10:01:58 [manheim.gb] INFO: Saving data for 2557325: {'created_time': 1764669718.016207, 'last_price_update_time': 1764669718.016222, 'auction_closing_time': 1764838800.0}
2025-12-02 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2557325') HTTP/1.1" 204 0
2025-12-02 10:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfaa090>
2025-12-02 10:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_19.jpg HTTP/1.1" 201 0
2025-12-02 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255783-4003462-1005.jpg') HTTP/1.1" 204 0
2025-12-02 10:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255783-4003462-1005.jpg saved to cache
2025-12-02 10:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 1636bef3-09f3-50b8-8ff7-dc154055d704
2025-12-02 10:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfce050>
2025-12-02 10:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_18.jpg HTTP/1.1" 201 0
2025-12-02 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255783-4003462-1004.jpg') HTTP/1.1" 204 0
2025-12-02 10:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255783-4003462-1004.jpg saved to cache
2025-12-02 10:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 1636bef3-09f3-50b8-8ff7-dc154055d704
2025-12-02 10:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2255783-4003462-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255783-01985373-002.pdf)
2025-12-02 10:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2255783-4003462-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255783-01985373-002.pdf)
2025-12-02 10:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ea2c90>
2025-12-02 10:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_17.jpg HTTP/1.1" 201 0
2025-12-02 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255783-4003462-1003.jpg') HTTP/1.1" 204 0
2025-12-02 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255783-4003462-1003.jpg saved to cache
2025-12-02 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 1636bef3-09f3-50b8-8ff7-dc154055d704
2025-12-02 10:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8d7e810>
2025-12-02 10:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_16.jpg HTTP/1.1" 201 0
2025-12-02 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255783-4003462-1002.jpg') HTTP/1.1" 204 0
2025-12-02 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255783-4003462-1002.jpg saved to cache
2025-12-02 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 1636bef3-09f3-50b8-8ff7-dc154055d704
2025-12-02 10:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2255783-4003462-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255783-01985373-002.pdf)
2025-12-02 10:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2255783-4003462-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255783-01985373-002.pdf)
2025-12-02 10:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ef3ed0>
2025-12-02 10:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_15.jpg HTTP/1.1" 201 0
2025-12-02 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255783-4003462-1001.jpg') HTTP/1.1" 204 0
2025-12-02 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255783-4003462-1001.jpg saved to cache
2025-12-02 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 1636bef3-09f3-50b8-8ff7-dc154055d704
2025-12-02 10:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8f95690>
2025-12-02 10:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_14.jpg HTTP/1.1" 201 0
2025-12-02 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255783-4003462-1000.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255783-4003462-1000.jpg saved to cache
2025-12-02 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 1636bef3-09f3-50b8-8ff7-dc154055d704
2025-12-02 10:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255783-01985373-002.pdf)
2025-12-02 10:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2255783-4003462-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255783-01985373-002.pdf)
2025-12-02 10:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8e81e90>
2025-12-02 10:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_12.jpg HTTP/1.1" 201 0
2025-12-02 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b36675d-ed13-48f1-8320-ca36411bdf70_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_4.jpg saved to cache
2025-12-02 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 1636bef3-09f3-50b8-8ff7-dc154055d704
2025-12-02 10:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8d7cf10>
2025-12-02 10:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_13.jpg HTTP/1.1" 201 0
2025-12-02 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255783-4003462-13.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255783-4003462-13.jpg saved to cache
2025-12-02 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 1636bef3-09f3-50b8-8ff7-dc154055d704
2025-12-02 10:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255783-01985373-002.pdf)
2025-12-02 10:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002512673-01988551-002.pdf> (referer: None)
2025-12-02 10:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8db67d0>
2025-12-02 10:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_11.jpg HTTP/1.1" 201 0
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b36675d-ed13-48f1-8320-ca36411bdf70_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_3.jpg saved to cache
2025-12-02 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 1636bef3-09f3-50b8-8ff7-dc154055d704
2025-12-02 10:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6dc0d0>
2025-12-02 10:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_expert_report_file_3fd4c717-16cb-44c4-acf0-fe06798b050b.pdf HTTP/1.1" 201 0
2025-12-02 10:02:01 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4
2025-12-02 10:02:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4, skipping ID generation
2025-12-02 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a9b9706-a15a-443d-864e-ba38e206311d_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_7.jpg not downloaded yet
2025-12-02 10:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255783-01985373-002.pdf)
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a9b9706-a15a-443d-864e-ba38e206311d_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_7.jpg not downloaded yet
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a9b9706-a15a-443d-864e-ba38e206311d_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_6.jpg not downloaded yet
2025-12-02 10:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255783-01985373-002.pdf)
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a9b9706-a15a-443d-864e-ba38e206311d_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_1.jpg not downloaded yet
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a9b9706-a15a-443d-864e-ba38e206311d_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_5.jpg not downloaded yet
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a9b9706-a15a-443d-864e-ba38e206311d_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_4.jpg not downloaded yet
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a9b9706-a15a-443d-864e-ba38e206311d_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_11.jpg not downloaded yet
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a9b9706-a15a-443d-864e-ba38e206311d_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_10.jpg not downloaded yet
2025-12-02 10:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8dfa2d0>
2025-12-02 10:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_10.jpg HTTP/1.1" 201 0
2025-12-02 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b36675d-ed13-48f1-8320-ca36411bdf70_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_5.jpg saved to cache
2025-12-02 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 1636bef3-09f3-50b8-8ff7-dc154055d704
2025-12-02 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a9b9706-a15a-443d-864e-ba38e206311d_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_9.jpg not downloaded yet
2025-12-02 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a9b9706-a15a-443d-864e-ba38e206311d_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_2.jpg not downloaded yet
2025-12-02 10:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002512673-01988551-002.pdf)
2025-12-02 10:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002512673-01988551-002.pdf)
2025-12-02 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a9b9706-a15a-443d-864e-ba38e206311d_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_5.jpg not downloaded yet
2025-12-02 10:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6f0950>
2025-12-02 10:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_9.jpg HTTP/1.1" 201 0
2025-12-02 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b36675d-ed13-48f1-8320-ca36411bdf70_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_2.jpg saved to cache
2025-12-02 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1636bef3-09f3-50b8-8ff7-dc154055d704
2025-12-02 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a9b9706-a15a-443d-864e-ba38e206311d_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_3.jpg not downloaded yet
2025-12-02 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a9b9706-a15a-443d-864e-ba38e206311d_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_4.jpg not downloaded yet
2025-12-02 10:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8fc5050>
2025-12-02 10:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_0.jpg HTTP/1.1" 201 0
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a9b9706-a15a-443d-864e-ba38e206311d_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_7.jpg saved to cache
2025-12-02 10:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4
2025-12-02 10:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8fd26d0>
2025-12-02 10:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_2.jpg HTTP/1.1" 201 0
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a9b9706-a15a-443d-864e-ba38e206311d_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_6.jpg saved to cache
2025-12-02 10:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2512673-4003704-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2512673-4003704-13.jpg not downloaded yet
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2512673-4003704-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2512673-4003704-1000.jpg not downloaded yet
2025-12-02 10:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002512673-01988551-002.pdf)
2025-12-02 10:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002512673-01988551-002.pdf)
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2512673-4003704-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2512673-4003704-1001.jpg not downloaded yet
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2512673-4003704-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2512673-4003704-1002.jpg not downloaded yet
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2512673-4003704-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2512673-4003704-1003.jpg not downloaded yet
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2512673-4003704-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2512673-4003704-1004.jpg not downloaded yet
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2512673-4003704-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2512673-4003704-1005.jpg not downloaded yet
2025-12-02 10:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8e68bd0>
2025-12-02 10:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_8.jpg HTTP/1.1" 201 0
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a9b9706-a15a-443d-864e-ba38e206311d_9.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_9.jpg saved to cache
2025-12-02 10:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4
2025-12-02 10:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca89119d0>
2025-12-02 10:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_9.jpg HTTP/1.1" 201 0
2025-12-02 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a9b9706-a15a-443d-864e-ba38e206311d_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_2.jpg saved to cache
2025-12-02 10:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4
2025-12-02 10:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2512673-4003704-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002512673-01988551-002.pdf)
2025-12-02 10:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2512673-4003704-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002512673-01988551-002.pdf)
2025-12-02 10:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf7ced0>
2025-12-02 10:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_14.jpg HTTP/1.1" 201 0
2025-12-02 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2512673-4003704-1000.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2512673-4003704-1000.jpg saved to cache
2025-12-02 10:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4
2025-12-02 10:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf6ed10>
2025-12-02 10:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_13.jpg HTTP/1.1" 201 0
2025-12-02 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2512673-4003704-13.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2512673-4003704-13.jpg saved to cache
2025-12-02 10:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4
2025-12-02 10:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2512673-4003704-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002512673-01988551-002.pdf)
2025-12-02 10:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2512673-4003704-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002512673-01988551-002.pdf)
2025-12-02 10:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8fa3d50>
2025-12-02 10:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_18.jpg HTTP/1.1" 201 0
2025-12-02 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2512673-4003704-1004.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2512673-4003704-1004.jpg saved to cache
2025-12-02 10:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4
2025-12-02 10:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=2252704&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232252704&indx=106> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/RENAULT/CAPTUR?id=2577653&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232577653&indx=148> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8f2b050>
2025-12-02 10:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 10:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_19.jpg HTTP/1.1" 201 0
2025-12-02 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2512673-4003704-1005.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2512673-4003704-1005.jpg saved to cache
2025-12-02 10:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4
2025-12-02 10:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2512673-4003704-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002512673-01988551-002.pdf)
2025-12-02 10:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2512673-4003704-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002512673-01988551-002.pdf)
2025-12-02 10:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c with identifier: 2252704
2025-12-02 10:02:05 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c
2025-12-02 10:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31c0caf2-0773-541d-b1c7-db18adc292da with identifier: 2577653
2025-12-02 10:02:05 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 31c0caf2-0773-541d-b1c7-db18adc292da
2025-12-02 10:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6f0f50>
2025-12-02 10:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_17.jpg HTTP/1.1" 201 0
2025-12-02 10:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2512673-4003704-1003.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2512673-4003704-1003.jpg saved to cache
2025-12-02 10:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4
2025-12-02 10:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf5f050>
2025-12-02 10:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_16.jpg HTTP/1.1" 201 0
2025-12-02 10:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2512673-4003704-1002.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2512673-4003704-1002.jpg saved to cache
2025-12-02 10:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4
2025-12-02 10:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002512673-01988551-002.pdf)
2025-12-02 10:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002512673-01988551-002.pdf)
2025-12-02 10:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002512673-01988551-002.pdf)
2025-12-02 10:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2512673-4003704-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002512673-01988551-002.pdf)
2025-12-02 10:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6bead0>
2025-12-02 10:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_10.jpg HTTP/1.1" 201 0
2025-12-02 10:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a9b9706-a15a-443d-864e-ba38e206311d_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_5.jpg saved to cache
2025-12-02 10:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4
2025-12-02 10:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002512673-01988551-002.pdf)
2025-12-02 10:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002512673-01988551-002.pdf)
2025-12-02 10:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8da1f10>
2025-12-02 10:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 10:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_12.jpg HTTP/1.1" 201 0
2025-12-02 10:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a9b9706-a15a-443d-864e-ba38e206311d_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_4.jpg saved to cache
2025-12-02 10:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4
2025-12-02 10:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf5bb10>
2025-12-02 10:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_11.jpg HTTP/1.1" 201 0
2025-12-02 10:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a9b9706-a15a-443d-864e-ba38e206311d_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_3.jpg saved to cache
2025-12-02 10:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4
2025-12-02 10:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf55a10>
2025-12-02 10:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_15.jpg HTTP/1.1" 201 0
2025-12-02 10:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2512673-4003704-1001.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2512673-4003704-1001.jpg saved to cache
2025-12-02 10:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4
2025-12-02 10:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b0b1410>
2025-12-02 10:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_7.jpg HTTP/1.1" 201 0
2025-12-02 10:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a9b9706-a15a-443d-864e-ba38e206311d_10.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_10.jpg saved to cache
2025-12-02 10:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4
2025-12-02 10:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6e3c10>
2025-12-02 10:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 10:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_6.jpg HTTP/1.1" 201 0
2025-12-02 10:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a9b9706-a15a-443d-864e-ba38e206311d_11.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_11.jpg saved to cache
2025-12-02 10:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4
2025-12-02 10:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002512673-01988551-002.pdf)
2025-12-02 10:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002512673-01988551-002.pdf)
2025-12-02 10:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002577653-01989447-001.pdf> (referer: None)
2025-12-02 10:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002252704-01986325-003.pdf> (referer: None)
2025-12-02 10:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6e1e50>
2025-12-02 10:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_4.jpg HTTP/1.1" 201 0
2025-12-02 10:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a9b9706-a15a-443d-864e-ba38e206311d_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_5.jpg saved to cache
2025-12-02 10:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4
2025-12-02 10:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8d99010>
2025-12-02 10:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_5.jpg HTTP/1.1" 201 0
2025-12-02 10:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a9b9706-a15a-443d-864e-ba38e206311d_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_4.jpg saved to cache
2025-12-02 10:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4
2025-12-02 10:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b0aa790>
2025-12-02 10:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_expert_report_file_3502bfa9-89ad-41dc-87d6-0f70df06523c.pdf HTTP/1.1" 201 0
2025-12-02 10:02:09 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 31c0caf2-0773-541d-b1c7-db18adc292da
2025-12-02 10:02:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31c0caf2-0773-541d-b1c7-db18adc292da, skipping ID generation
2025-12-02 10:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 31c0caf2-0773-541d-b1c7-db18adc292da
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-824cdc5e-158a-4ddd-a0ef-81348518c250.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-824cdc5e-158a-4ddd-a0ef-81348518c250.jpg not downloaded yet
2025-12-02 10:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6ec250>
2025-12-02 10:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_expert_report_file_e940bf99-e77a-428c-8263-1664c933a6da.pdf HTTP/1.1" 201 0
2025-12-02 10:02:10 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c
2025-12-02 10:02:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c, skipping ID generation
2025-12-02 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2252704-9999999-335124545-004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-004.jpg not downloaded yet
2025-12-02 10:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002512673-01988551-002.pdf)
2025-12-02 10:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002512673-01988551-002.pdf)
2025-12-02 10:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255783-01985373-002.pdf)
2025-12-02 10:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255783-01985373-002.pdf)
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_7.jpg not downloaded yet
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2252704-9999999-335124545-008.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-008.jpg not downloaded yet
2025-12-02 10:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=2365471&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232365471&indx=124> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-f55a4504-4901-4415-9afe-a867bc31a94e.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-f55a4504-4901-4415-9afe-a867bc31a94e.jpg not downloaded yet
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2252704-9999999-335124545-001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-001.jpg not downloaded yet
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-daec6989-9eb4-477c-a4ed-2bd508705567.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-daec6989-9eb4-477c-a4ed-2bd508705567.jpg not downloaded yet
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2252704-9999999-335124545-002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-002.jpg not downloaded yet
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-039de38f-be5e-43a7-99eb-480e1a5fb4cf.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-039de38f-be5e-43a7-99eb-480e1a5fb4cf.jpg not downloaded yet
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2252704-9999999-335124545-003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-003.jpg not downloaded yet
2025-12-02 10:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ebf890>
2025-12-02 10:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_1.jpg HTTP/1.1" 201 0
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a9b9706-a15a-443d-864e-ba38e206311d_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_7.jpg saved to cache
2025-12-02 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4
2025-12-02 10:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfdfe10>
2025-12-02 10:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_3.jpg HTTP/1.1" 201 0
2025-12-02 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9a9b9706-a15a-443d-864e-ba38e206311d_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_1.jpg saved to cache
2025-12-02 10:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4
2025-12-02 10:02:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4, skipping ID generation
2025-12-02 10:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4 from tracking dictionaries
2025-12-02 10:02:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4 sending to next pipeline
2025-12-02 10:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4, identifier: 2512673
2025-12-02 10:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6c4910>
2025-12-02 10:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_8.jpg HTTP/1.1" 201 0
2025-12-02 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b36675d-ed13-48f1-8320-ca36411bdf70_9.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_9.jpg saved to cache
2025-12-02 10:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1636bef3-09f3-50b8-8ff7-dc154055d704
2025-12-02 10:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6f1350>
2025-12-02 10:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_7.jpg HTTP/1.1" 201 0
2025-12-02 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b36675d-ed13-48f1-8320-ca36411bdf70_10.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_10.jpg saved to cache
2025-12-02 10:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1636bef3-09f3-50b8-8ff7-dc154055d704
2025-12-02 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-f4b602c6-adcb-4173-9f8f-bc1d6232e39e.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-f4b602c6-adcb-4173-9f8f-bc1d6232e39e.jpg not downloaded yet
2025-12-02 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2252704-9999999-335124545-005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-005.jpg not downloaded yet
2025-12-02 10:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4 with identifier: 2512673
2025-12-02 10:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 10:02:12 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Black HTTP/1.1" 200 None
2025-12-02 10:02:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 10:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4 with identifier: 2512673
2025-12-02 10:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 31aa8784-f5fc-5c42-87a9-41eed7f5bdd4 with identifier: 2512673 to the API
2025-12-02 10:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 10:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 10:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_expert_report_file_3fd4c717-16cb-44c4-acf0-fe06798b050b.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002512673-01988551-002.pdf',
'color': 'Black',
'currency': 'GBP',
'engine': '1.2L',
'expiration_date': '2025-12-04T09:00:00Z',
'fuel_type': 'Petrol',
'id': '31aa8784-f5fc-5c42-87a9-41eed7f5bdd4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LS67SMU',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/108?id=2512673',
'listing': 'auction',
'location': 'Colchester',
'make': 'PEUGEOT',
'model': '108',
'odometer': 71830,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 34,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 152862,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 152862,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245748,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 203434,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 153744,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154577,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 152268,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 145122,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 136146,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261372,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 235810,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 262112,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289913,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9a9b9706-a15a-443d-864e-ba38e206311d_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307317,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2512673-4003704-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 264426,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2512673-4003704-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 399384,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2512673-4003704-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319556,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2512673-4003704-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310089,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2512673-4003704-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 255630,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2512673-4003704-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31aa8784-f5fc-5c42-87a9-41eed7f5bdd4/31aa8784-f5fc-5c42-87a9-41eed7f5bdd4_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315359,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2512673-4003704-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-28',
'seller_name': 'Big Motoring World Ltd',
'title': 'PEUGEOT 108 1.2 PureTech Allure 5dr',
'transmission': 'manual',
'trim': '1.2 PureTech Allure 5dr',
'year': 2017}
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272512673%27 HTTP/1.1" 200 None
2025-12-02 10:02:13 [manheim.gb] INFO: Saving data for 2512673: {'created_time': 1764669733.047601, 'last_price_update_time': 1764669733.047611, 'auction_closing_time': 1764838800.0}
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2512673') HTTP/1.1" 204 0
2025-12-02 10:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89e89f67-004a-563b-b80d-d2bf3249c4e4 with identifier: 2365471
2025-12-02 10:02:13 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 89e89f67-004a-563b-b80d-d2bf3249c4e4
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-c9d9d256-2e22-4f04-a281-9a631e57aca4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-c9d9d256-2e22-4f04-a281-9a631e57aca4.jpg not downloaded yet
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2252704-9999999-335124545-006.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-006.jpg not downloaded yet
2025-12-02 10:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255783-01985373-002.pdf)
2025-12-02 10:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-824cdc5e-158a-4ddd-a0ef-81348518c250.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002577653-01989447-001.pdf)
2025-12-02 10:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255783-01985373-002.pdf)
2025-12-02 10:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255783-01985373-002.pdf)
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_10.jpg not downloaded yet
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2252704-9999999-335124545-007.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-007.jpg not downloaded yet
2025-12-02 10:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002252704-01986325-003.pdf)
2025-12-02 10:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=1078284&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231078284&indx=4> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_9.jpg not downloaded yet
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2252704-9999999-335124545-009.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-009.jpg not downloaded yet
2025-12-02 10:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_2.jpg not downloaded yet
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2252704-9999999-335124545-010.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-010.jpg not downloaded yet
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_5.jpg not downloaded yet
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2252704-9999999-335124545-011.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-011.jpg not downloaded yet
2025-12-02 10:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b0b0b90>
2025-12-02 10:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_3.jpg HTTP/1.1" 201 0
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b36675d-ed13-48f1-8320-ca36411bdf70_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_1.jpg saved to cache
2025-12-02 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1636bef3-09f3-50b8-8ff7-dc154055d704
2025-12-02 10:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf71710>
2025-12-02 10:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_0.jpg HTTP/1.1" 201 0
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-824cdc5e-158a-4ddd-a0ef-81348518c250.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-824cdc5e-158a-4ddd-a0ef-81348518c250.jpg saved to cache
2025-12-02 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31c0caf2-0773-541d-b1c7-db18adc292da
2025-12-02 10:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf85790>
2025-12-02 10:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_6.jpg HTTP/1.1" 201 0
2025-12-02 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b36675d-ed13-48f1-8320-ca36411bdf70_11.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_11.jpg saved to cache
2025-12-02 10:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1636bef3-09f3-50b8-8ff7-dc154055d704
2025-12-02 10:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8de3a90>
2025-12-02 10:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_4.jpg HTTP/1.1" 201 0
2025-12-02 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b36675d-ed13-48f1-8320-ca36411bdf70_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_5.jpg saved to cache
2025-12-02 10:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1636bef3-09f3-50b8-8ff7-dc154055d704
2025-12-02 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_3.jpg not downloaded yet
2025-12-02 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2252704-9999999-335124545-012.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-012.jpg not downloaded yet
2025-12-02 10:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6c9210>
2025-12-02 10:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_0.jpg HTTP/1.1" 201 0
2025-12-02 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2252704-9999999-335124545-004.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-004.jpg saved to cache
2025-12-02 10:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c
2025-12-02 10:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e98221d2-af70-53bc-8648-369d529ec3f3 with identifier: 1078284
2025-12-02 10:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e98221d2-af70-53bc-8648-369d529ec3f3 with scrape type 2
2025-12-02 10:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e98221d2-af70-53bc-8648-369d529ec3f3 with scrape type 2
2025-12-02 10:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e98221d2-af70-53bc-8648-369d529ec3f3, identifier: 1078284
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_4.jpg not downloaded yet
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2252704-4003448-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-13.jpg not downloaded yet
2025-12-02 10:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e98221d2-af70-53bc-8648-369d529ec3f3 with identifier: 1078284
2025-12-02 10:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e98221d2-af70-53bc-8648-369d529ec3f3 with identifier: 1078284
2025-12-02 10:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 11 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
11
2025-12-02 10:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: e98221d2-af70-53bc-8648-369d529ec3f3 spider: manheim.gb
2025-12-02 10:02:15 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: e98221d2-af70-53bc-8648-369d529ec3f3 due to rule: registration_date_old.json, error: 11 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
11
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001078284-01982526-002.pdf',
'color': 'BLACK',
'currency': 'GBP',
'engine': '1.0L',
'expiration_date': '2025-12-04T09:00:00Z',
'fuel_type': 'Petrol',
'id': 'e98221d2-af70-53bc-8648-369d529ec3f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RK64XPP',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=1078284',
'listing': 'auction',
'location': 'Bristol',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 82832,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-26',
'seller_name': 'Mon Motors',
'title': 'FORD FIESTA 1.0 EcoBoost Titanium X 5dr',
'transmission': 'manual',
'trim': '1.0 EcoBoost Titanium X 5dr',
'year': 2014}
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271078284%27 HTTP/1.1" 200 None
2025-12-02 10:02:15 [manheim.gb] INFO: Saving data for 1078284: {'auction_closing_time': 1764838800.0, 'created_time': 1764100889.310579, 'last_price_update_time': 1764669735.374498}
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1078284') HTTP/1.1" 204 0
2025-12-02 10:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-c9d9d256-2e22-4f04-a281-9a631e57aca4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002577653-01989447-001.pdf)
2025-12-02 10:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002577653-01989447-001.pdf)
2025-12-02 10:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002252704-01986325-003.pdf)
2025-12-02 10:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002252704-01986325-003.pdf)
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2577653-4004161-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2577653-4004161-13.jpg not downloaded yet
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2252704-4003448-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1000.jpg not downloaded yet
2025-12-02 10:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-007.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002252704-01986325-003.pdf)
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2577653-4004161-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2577653-4004161-1000.jpg not downloaded yet
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2252704-4003448-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1001.jpg not downloaded yet
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2577653-4004161-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2577653-4004161-1001.jpg not downloaded yet
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2252704-4003448-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1002.jpg not downloaded yet
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2577653-4004161-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2577653-4004161-1002.jpg not downloaded yet
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2252704-4003448-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1003.jpg not downloaded yet
2025-12-02 10:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf26f50>
2025-12-02 10:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_6.jpg HTTP/1.1" 201 0
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-c9d9d256-2e22-4f04-a281-9a631e57aca4.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-c9d9d256-2e22-4f04-a281-9a631e57aca4.jpg saved to cache
2025-12-02 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 31c0caf2-0773-541d-b1c7-db18adc292da
2025-12-02 10:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b0ab850>
2025-12-02 10:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_7.jpg HTTP/1.1" 201 0
2025-12-02 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_10.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_10.jpg saved to cache
2025-12-02 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 31c0caf2-0773-541d-b1c7-db18adc292da
2025-12-02 10:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ef3a10>
2025-12-02 10:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_6.jpg HTTP/1.1" 201 0
2025-12-02 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2252704-9999999-335124545-006.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-006.jpg saved to cache
2025-12-02 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c
2025-12-02 10:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf25a90>
2025-12-02 10:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_5.jpg HTTP/1.1" 201 0
2025-12-02 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2252704-9999999-335124545-005.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-005.jpg saved to cache
2025-12-02 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c
2025-12-02 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2577653-4004161-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2577653-4004161-1003.jpg not downloaded yet
2025-12-02 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2252704-4003448-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1004.jpg not downloaded yet
2025-12-02 10:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8f7a110>
2025-12-02 10:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_7.jpg HTTP/1.1" 201 0
2025-12-02 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2252704-9999999-335124545-007.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-007.jpg saved to cache
2025-12-02 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c
2025-12-02 10:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002577653-01989447-001.pdf)
2025-12-02 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2577653-4004161-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2577653-4004161-1004.jpg not downloaded yet
2025-12-02 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2252704-4003448-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1005.jpg not downloaded yet
2025-12-02 10:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002577653-01989447-001.pdf)
2025-12-02 10:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-012.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002252704-01986325-003.pdf)
2025-12-02 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2577653-4004161-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2577653-4004161-1005.jpg not downloaded yet
2025-12-02 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2252704-4003448-1006.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1006.jpg not downloaded yet
2025-12-02 10:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002252704-01986325-003.pdf)
2025-12-02 10:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002252704-01986325-003.pdf)
2025-12-02 10:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002365471-01958485-002.pdf> (referer: None)
2025-12-02 10:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8e72010>
2025-12-02 10:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 10:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_12.jpg HTTP/1.1" 201 0
2025-12-02 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_4.jpg saved to cache
2025-12-02 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 31c0caf2-0773-541d-b1c7-db18adc292da
2025-12-02 10:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2577653-4004161-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002577653-01989447-001.pdf)
2025-12-02 10:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002252704-01986325-003.pdf)
2025-12-02 10:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b0a61d0>
2025-12-02 10:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_11.jpg HTTP/1.1" 201 0
2025-12-02 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_3.jpg saved to cache
2025-12-02 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 31c0caf2-0773-541d-b1c7-db18adc292da
2025-12-02 10:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8eb1310>
2025-12-02 10:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_11.jpg HTTP/1.1" 201 0
2025-12-02 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2252704-9999999-335124545-012.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-012.jpg saved to cache
2025-12-02 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c
2025-12-02 10:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8eb3ed0>
2025-12-02 10:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_12.jpg HTTP/1.1" 201 0
2025-12-02 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2252704-4003448-13.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-13.jpg saved to cache
2025-12-02 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c
2025-12-02 10:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b0a48d0>
2025-12-02 10:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_13.jpg HTTP/1.1" 201 0
2025-12-02 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2252704-4003448-1000.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1000.jpg saved to cache
2025-12-02 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c
2025-12-02 10:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6f0bd0>
2025-12-02 10:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89e89f67-004a-563b-b80d-d2bf3249c4e4/89e89f67-004a-563b-b80d-d2bf3249c4e4_expert_report_file_64667298-5539-4c6c-8868-f87b3c519d2c.pdf HTTP/1.1" 201 0
2025-12-02 10:02:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 89e89f67-004a-563b-b80d-d2bf3249c4e4
2025-12-02 10:02:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89e89f67-004a-563b-b80d-d2bf3249c4e4, skipping ID generation
2025-12-02 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 89e89f67-004a-563b-b80d-d2bf3249c4e4
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf095285-47df-4d01-bd35-e42d106b2170_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_ext_7.jpg already downloaded
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf095285-47df-4d01-bd35-e42d106b2170_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_ext_7.jpg already downloaded
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf095285-47df-4d01-bd35-e42d106b2170_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_ext_6.jpg already downloaded
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf095285-47df-4d01-bd35-e42d106b2170_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_ext_1.jpg already downloaded
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf095285-47df-4d01-bd35-e42d106b2170_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_5.jpg already downloaded
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf095285-47df-4d01-bd35-e42d106b2170_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_4.jpg already downloaded
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf095285-47df-4d01-bd35-e42d106b2170_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_11.jpg already downloaded
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf095285-47df-4d01-bd35-e42d106b2170_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_10.jpg already downloaded
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf095285-47df-4d01-bd35-e42d106b2170_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_9.jpg already downloaded
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf095285-47df-4d01-bd35-e42d106b2170_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_ext_2.jpg already downloaded
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf095285-47df-4d01-bd35-e42d106b2170_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_ext_5.jpg already downloaded
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf095285-47df-4d01-bd35-e42d106b2170_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_ext_3.jpg already downloaded
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf095285-47df-4d01-bd35-e42d106b2170_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_ext_4.jpg already downloaded
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2365471-3969697-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2365471-3969697-13.jpg already downloaded
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2365471-3969697-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2365471-3969697-1000.jpg already downloaded
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2365471-3969697-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2365471-3969697-1001.jpg already downloaded
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2365471-3969697-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2365471-3969697-1002.jpg already downloaded
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2365471-3969697-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2365471-3969697-1003.jpg already downloaded
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2365471-3969697-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2365471-3969697-1004.jpg already downloaded
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2365471-3969697-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2365471-3969697-1005.jpg already downloaded
2025-12-02 10:02:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 89e89f67-004a-563b-b80d-d2bf3249c4e4, identifier: 2365471
2025-12-02 10:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search) ['zyte-api']
2025-12-02 10:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 89e89f67-004a-563b-b80d-d2bf3249c4e4 with identifier: 2365471
2025-12-02 10:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 89e89f67-004a-563b-b80d-d2bf3249c4e4 with identifier: 2365471
2025-12-02 10:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 181776 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
181776
2025-12-02 10:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 89e89f67-004a-563b-b80d-d2bf3249c4e4 spider: manheim.gb
2025-12-02 10:02:20 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 89e89f67-004a-563b-b80d-d2bf3249c4e4 due to rule: high_mileage_for_country.json, error: 181776 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
181776
{'auction_title': '',
'c_o_2_emission_value': 103,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e89f67-004a-563b-b80d-d2bf3249c4e4/89e89f67-004a-563b-b80d-d2bf3249c4e4_expert_report_file_64667298-5539-4c6c-8868-f87b3c519d2c.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002365471-01958485-002.pdf',
'color': 'BLACK',
'currency': 'GBP',
'engine': '1.5L',
'expiration_date': '2025-12-04T09:00:00Z',
'fuel_type': 'Diesel',
'id': '89e89f67-004a-563b-b80d-d2bf3249c4e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YR16OVK',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=2365471',
'listing': 'auction',
'location': 'Colchester',
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 112951,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 43,
'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_ext_7.jpg',
'http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_ext_7.jpg',
'http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_ext_6.jpg',
'http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_ext_1.jpg',
'http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_5.jpg',
'http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_4.jpg',
'http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_11.jpg',
'http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_10.jpg',
'http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_9.jpg',
'http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_ext_2.jpg',
'http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_ext_5.jpg',
'http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_ext_3.jpg',
'http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_ext_4.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2365471-3969697-13.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2365471-3969697-1000.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2365471-3969697-1001.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2365471-3969697-1002.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2365471-3969697-1003.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2365471-3969697-1004.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2365471-3969697-1005.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e89f67-004a-563b-b80d-d2bf3249c4e4/89e89f67-004a-563b-b80d-d2bf3249c4e4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 218999,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e89f67-004a-563b-b80d-d2bf3249c4e4/89e89f67-004a-563b-b80d-d2bf3249c4e4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 218999,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e89f67-004a-563b-b80d-d2bf3249c4e4/89e89f67-004a-563b-b80d-d2bf3249c4e4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223598,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e89f67-004a-563b-b80d-d2bf3249c4e4/89e89f67-004a-563b-b80d-d2bf3249c4e4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 162392,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e89f67-004a-563b-b80d-d2bf3249c4e4/89e89f67-004a-563b-b80d-d2bf3249c4e4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 205944,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e89f67-004a-563b-b80d-d2bf3249c4e4/89e89f67-004a-563b-b80d-d2bf3249c4e4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 200850,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e89f67-004a-563b-b80d-d2bf3249c4e4/89e89f67-004a-563b-b80d-d2bf3249c4e4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 202240,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e89f67-004a-563b-b80d-d2bf3249c4e4/89e89f67-004a-563b-b80d-d2bf3249c4e4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199315,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e89f67-004a-563b-b80d-d2bf3249c4e4/89e89f67-004a-563b-b80d-d2bf3249c4e4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223038,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e89f67-004a-563b-b80d-d2bf3249c4e4/89e89f67-004a-563b-b80d-d2bf3249c4e4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281764,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e89f67-004a-563b-b80d-d2bf3249c4e4/89e89f67-004a-563b-b80d-d2bf3249c4e4_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 236878,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e89f67-004a-563b-b80d-d2bf3249c4e4/89e89f67-004a-563b-b80d-d2bf3249c4e4_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 243220,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e89f67-004a-563b-b80d-d2bf3249c4e4/89e89f67-004a-563b-b80d-d2bf3249c4e4_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305039,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df095285-47df-4d01-bd35-e42d106b2170_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e89f67-004a-563b-b80d-d2bf3249c4e4/89e89f67-004a-563b-b80d-d2bf3249c4e4_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 173333,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2365471-3969697-13.jpg',
'Width': 749},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e89f67-004a-563b-b80d-d2bf3249c4e4/89e89f67-004a-563b-b80d-d2bf3249c4e4_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 193997,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2365471-3969697-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e89f67-004a-563b-b80d-d2bf3249c4e4/89e89f67-004a-563b-b80d-d2bf3249c4e4_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154481,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2365471-3969697-1001.jpg',
'Width': 749},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e89f67-004a-563b-b80d-d2bf3249c4e4/89e89f67-004a-563b-b80d-d2bf3249c4e4_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 130584,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2365471-3969697-1002.jpg',
'Width': 749},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e89f67-004a-563b-b80d-d2bf3249c4e4/89e89f67-004a-563b-b80d-d2bf3249c4e4_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 183943,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2365471-3969697-1003.jpg',
'Width': 749},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e89f67-004a-563b-b80d-d2bf3249c4e4/89e89f67-004a-563b-b80d-d2bf3249c4e4_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311131,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2365471-3969697-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e89f67-004a-563b-b80d-d2bf3249c4e4/89e89f67-004a-563b-b80d-d2bf3249c4e4_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 256861,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2365471-3969697-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-29',
'seller_name': 'MotoNovo Finance',
'title': 'NISSAN QASHQAI 1.5 dCi N-Connecta 5dr',
'transmission': 'manual',
'trim': '1.5 dCi N-Connecta 5dr',
'year': 2016}
2025-12-02 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272365471%27 HTTP/1.1" 200 None
2025-12-02 10:02:20 [manheim.gb] INFO: Saving data for 2365471: {'created_time': 1764669740.291242, 'last_price_update_time': 1764669740.291253, 'auction_closing_time': 1764838800.0}
2025-12-02 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2365471') HTTP/1.1" 204 0
2025-12-02 10:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2577653-4004161-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002577653-01989447-001.pdf)
2025-12-02 10:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FIAT/500?id=2616439&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232616439&indx=153> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002252704-01986325-003.pdf)
2025-12-02 10:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002252704-01986325-003.pdf)
2025-12-02 10:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8e48050>
2025-12-02 10:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_17.jpg HTTP/1.1" 201 0
2025-12-02 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2577653-4004161-1003.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2577653-4004161-1003.jpg saved to cache
2025-12-02 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 31c0caf2-0773-541d-b1c7-db18adc292da
2025-12-02 10:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bffa6d0>
2025-12-02 10:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_19.jpg HTTP/1.1" 201 0
2025-12-02 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2252704-4003448-1006.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1006.jpg saved to cache
2025-12-02 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c
2025-12-02 10:02:20 [manheim.gb] INFO: Found listing with ID: 2907665
2025-12-02 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272907665%27 HTTP/1.1" 200 None
2025-12-02 10:02:20 [manheim.gb] INFO: Scrape type for 2907665: 0
2025-12-02 10:02:20 [manheim.gb] INFO: Found listing with ID: 2933109
2025-12-02 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272933109%27 HTTP/1.1" 200 None
2025-12-02 10:02:20 [manheim.gb] INFO: Scrape type for 2933109: 1
2025-12-02 10:02:20 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
scraped_item = self._extract_listing_item(item, expiration_date)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
item["odometer"] = odometer
~~~~^^^^^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-02 10:02:21 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
scraped_item = self._extract_listing_item(item, expiration_date)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
item["odometer"] = odometer
~~~~^^^^^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-02 10:02:21 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
scraped_item = self._extract_listing_item(item, expiration_date)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
item["odometer"] = odometer
~~~~^^^^^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-02 10:02:21 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
scraped_item = self._extract_listing_item(item, expiration_date)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
item["odometer"] = odometer
~~~~^^^^^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-02 10:02:21 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
scraped_item = self._extract_listing_item(item, expiration_date)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
item["odometer"] = odometer
~~~~^^^^^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-02 10:02:21 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
scraped_item = self._extract_listing_item(item, expiration_date)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
item["odometer"] = odometer
~~~~^^^^^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-02 10:02:21 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
scraped_item = self._extract_listing_item(item, expiration_date)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
item["odometer"] = odometer
~~~~^^^^^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-02 10:02:21 [scrapy.core.scraper] ERROR: Spider error processing <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search)
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 295, in aiter_errback
yield await it.__anext__()
^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
return await self.data.__anext__()
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
async for o in as_async_generator(it):
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
async for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
return await self.data.__anext__()
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
async for o in as_async_generator(it):
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
async for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/_middlewares.py", line 206, in process_spider_output_async
async for item_or_request in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
scraped_item = self._extract_listing_item(item, expiration_date)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
item["odometer"] = odometer
~~~~^^^^^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-02 10:02:21 [scrapy.extensions.logstats] INFO: Crawled 31 pages (at 26 pages/min), scraped 3 items (at 3 items/min)
2025-12-02 10:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/XTRAIL?id=2358676&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232358676&indx=123> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8e73510>
2025-12-02 10:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_19.jpg HTTP/1.1" 201 0
2025-12-02 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2577653-4004161-1005.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2577653-4004161-1005.jpg saved to cache
2025-12-02 10:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 31c0caf2-0773-541d-b1c7-db18adc292da
2025-12-02 10:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ad5f07d-7d59-5c97-b50e-8854e5959ba6 with identifier: 2616439
2025-12-02 10:02:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5ad5f07d-7d59-5c97-b50e-8854e5959ba6
2025-12-02 10:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6c8510>
2025-12-02 10:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_16.jpg HTTP/1.1" 201 0
2025-12-02 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2252704-4003448-1003.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1003.jpg saved to cache
2025-12-02 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c
2025-12-02 10:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8eeec10>
2025-12-02 10:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_17.jpg HTTP/1.1" 201 0
2025-12-02 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2252704-4003448-1004.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1004.jpg saved to cache
2025-12-02 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c
2025-12-02 10:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/AUDI/Q5?id=2407950&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232407950&indx=128> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2577653-4004161-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002577653-01989447-001.pdf)
2025-12-02 10:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2577653-4004161-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002577653-01989447-001.pdf)
2025-12-02 10:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2577653-4004161-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002577653-01989447-001.pdf)
2025-12-02 10:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2577653-4004161-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002577653-01989447-001.pdf)
2025-12-02 10:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002252704-01986325-003.pdf)
2025-12-02 10:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0a60891-85d9-52bc-bc6a-9475f7562d0e with identifier: 2358676
2025-12-02 10:02:22 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d0a60891-85d9-52bc-bc6a-9475f7562d0e
2025-12-02 10:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002252704-01986325-003.pdf)
2025-12-02 10:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2577653-4004161-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002577653-01989447-001.pdf)
2025-12-02 10:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002252704-01986325-003.pdf)
2025-12-02 10:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c7b23d3-2d65-54db-9f4c-4b1609f74249 with identifier: 2407950
2025-12-02 10:02:22 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9c7b23d3-2d65-54db-9f4c-4b1609f74249
2025-12-02 10:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ec6090>
2025-12-02 10:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_15.jpg HTTP/1.1" 201 0
2025-12-02 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2577653-4004161-1001.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2577653-4004161-1001.jpg saved to cache
2025-12-02 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 31c0caf2-0773-541d-b1c7-db18adc292da
2025-12-02 10:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfd7810>
2025-12-02 10:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_16.jpg HTTP/1.1" 201 0
2025-12-02 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2577653-4004161-1002.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2577653-4004161-1002.jpg saved to cache
2025-12-02 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 31c0caf2-0773-541d-b1c7-db18adc292da
2025-12-02 10:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf25490>
2025-12-02 10:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_14.jpg HTTP/1.1" 201 0
2025-12-02 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2577653-4004161-1000.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2577653-4004161-1000.jpg saved to cache
2025-12-02 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 31c0caf2-0773-541d-b1c7-db18adc292da
2025-12-02 10:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8d5af50>
2025-12-02 10:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_18.jpg HTTP/1.1" 201 0
2025-12-02 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2577653-4004161-1004.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2577653-4004161-1004.jpg saved to cache
2025-12-02 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 31c0caf2-0773-541d-b1c7-db18adc292da
2025-12-02 10:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/SEAT/IBIZA?id=2642791&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232642791&indx=156> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ebd450>
2025-12-02 10:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_18.jpg HTTP/1.1" 201 0
2025-12-02 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2252704-4003448-1005.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1005.jpg saved to cache
2025-12-02 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c
2025-12-02 10:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ebda90>
2025-12-02 10:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_15.jpg HTTP/1.1" 201 0
2025-12-02 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2252704-4003448-1002.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1002.jpg saved to cache
2025-12-02 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c
2025-12-02 10:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf5bf50>
2025-12-02 10:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_13.jpg HTTP/1.1" 201 0
2025-12-02 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2577653-4004161-13.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2577653-4004161-13.jpg saved to cache
2025-12-02 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 31c0caf2-0773-541d-b1c7-db18adc292da
2025-12-02 10:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf5a110>
2025-12-02 10:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_14.jpg HTTP/1.1" 201 0
2025-12-02 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2252704-4003448-1001.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1001.jpg saved to cache
2025-12-02 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c
2025-12-02 10:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-010.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002252704-01986325-003.pdf)
2025-12-02 10:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002577653-01989447-001.pdf)
2025-12-02 10:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-011.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002252704-01986325-003.pdf)
2025-12-02 10:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-f4b602c6-adcb-4173-9f8f-bc1d6232e39e.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002577653-01989447-001.pdf)
2025-12-02 10:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-009.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002252704-01986325-003.pdf)
2025-12-02 10:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002577653-01989447-001.pdf)
2025-12-02 10:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002577653-01989447-001.pdf)
2025-12-02 10:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002252704-01986325-003.pdf)
2025-12-02 10:02:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb926208-3f8e-5995-916f-1443a266be67 with identifier: 2642791
2025-12-02 10:02:25 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item eb926208-3f8e-5995-916f-1443a266be67
2025-12-02 10:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002616439-01987815-003.pdf> (referer: None)
2025-12-02 10:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002358676-01989476-002.pdf> (referer: None)
2025-12-02 10:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf86490>
2025-12-02 10:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_9.jpg HTTP/1.1" 201 0
2025-12-02 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2252704-9999999-335124545-010.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-010.jpg saved to cache
2025-12-02 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c
2025-12-02 10:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8911a10>
2025-12-02 10:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_10.jpg HTTP/1.1" 201 0
2025-12-02 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_5.jpg saved to cache
2025-12-02 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 31c0caf2-0773-541d-b1c7-db18adc292da
2025-12-02 10:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b640f90>
2025-12-02 10:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_10.jpg HTTP/1.1" 201 0
2025-12-02 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2252704-9999999-335124545-011.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-011.jpg saved to cache
2025-12-02 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c
2025-12-02 10:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8911750>
2025-12-02 10:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_5.jpg HTTP/1.1" 201 0
2025-12-02 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-f4b602c6-adcb-4173-9f8f-bc1d6232e39e.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-f4b602c6-adcb-4173-9f8f-bc1d6232e39e.jpg saved to cache
2025-12-02 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 31c0caf2-0773-541d-b1c7-db18adc292da
2025-12-02 10:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf15590>
2025-12-02 10:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_8.jpg HTTP/1.1" 201 0
2025-12-02 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2252704-9999999-335124545-009.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-009.jpg saved to cache
2025-12-02 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c
2025-12-02 10:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ea48d0>
2025-12-02 10:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_9.jpg HTTP/1.1" 201 0
2025-12-02 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_2.jpg saved to cache
2025-12-02 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 31c0caf2-0773-541d-b1c7-db18adc292da
2025-12-02 10:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf6f0d0>
2025-12-02 10:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_8.jpg HTTP/1.1" 201 0
2025-12-02 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_9.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_9.jpg saved to cache
2025-12-02 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 31c0caf2-0773-541d-b1c7-db18adc292da
2025-12-02 10:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8fd0cd0>
2025-12-02 10:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_4.jpg HTTP/1.1" 201 0
2025-12-02 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2252704-9999999-335124545-003.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-003.jpg saved to cache
2025-12-02 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c
2025-12-02 10:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b629310>
2025-12-02 10:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_expert_report_file_7e396dba-99ef-4ba3-b6b5-3d3819b7b76d.pdf HTTP/1.1" 201 0
2025-12-02 10:02:28 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5ad5f07d-7d59-5c97-b50e-8854e5959ba6
2025-12-02 10:02:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5ad5f07d-7d59-5c97-b50e-8854e5959ba6, skipping ID generation
2025-12-02 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 5ad5f07d-7d59-5c97-b50e-8854e5959ba6
2025-12-02 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_7.jpg not downloaded yet
2025-12-02 10:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ef0050>
2025-12-02 10:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_expert_report_file_55886fed-6b62-4f00-bf32-a80e408f5882.pdf HTTP/1.1" 201 0
2025-12-02 10:02:29 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d0a60891-85d9-52bc-bc6a-9475f7562d0e
2025-12-02 10:02:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d0a60891-85d9-52bc-bc6a-9475f7562d0e, skipping ID generation
2025-12-02 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item d0a60891-85d9-52bc-bc6a-9475f7562d0e
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_7.jpg not downloaded yet
2025-12-02 10:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002577653-01989447-001.pdf)
2025-12-02 10:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-039de38f-be5e-43a7-99eb-480e1a5fb4cf.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002577653-01989447-001.pdf)
2025-12-02 10:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-f55a4504-4901-4415-9afe-a867bc31a94e.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002577653-01989447-001.pdf)
2025-12-02 10:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-008.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002252704-01986325-003.pdf)
2025-12-02 10:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002252704-01986325-003.pdf)
2025-12-02 10:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255783-01985373-002.pdf)
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_7.jpg not downloaded yet
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_7.jpg not downloaded yet
2025-12-02 10:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002252704-01986325-003.pdf)
2025-12-02 10:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/Img-daec6989-9eb4-477c-a4ed-2bd508705567.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002577653-01989447-001.pdf)
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_6.jpg not downloaded yet
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_6.jpg not downloaded yet
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_1.jpg not downloaded yet
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_1.jpg not downloaded yet
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdab41d7a-9a61-4e71-bd2b-daecfce2b3fe_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_5.jpg not downloaded yet
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_5.jpg not downloaded yet
2025-12-02 10:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8912cd0>
2025-12-02 10:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_1.jpg HTTP/1.1" 201 0
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_7.jpg saved to cache
2025-12-02 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 31c0caf2-0773-541d-b1c7-db18adc292da
2025-12-02 10:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf64590>
2025-12-02 10:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_4.jpg HTTP/1.1" 201 0
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-039de38f-be5e-43a7-99eb-480e1a5fb4cf.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-039de38f-be5e-43a7-99eb-480e1a5fb4cf.jpg saved to cache
2025-12-02 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 31c0caf2-0773-541d-b1c7-db18adc292da
2025-12-02 10:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b613cd0>
2025-12-02 10:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_2.jpg HTTP/1.1" 201 0
2025-12-02 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-f55a4504-4901-4415-9afe-a867bc31a94e.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-f55a4504-4901-4415-9afe-a867bc31a94e.jpg saved to cache
2025-12-02 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 31c0caf2-0773-541d-b1c7-db18adc292da
2025-12-02 10:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8db6f10>
2025-12-02 10:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_1.jpg HTTP/1.1" 201 0
2025-12-02 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2252704-9999999-335124545-008.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-008.jpg saved to cache
2025-12-02 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c
2025-12-02 10:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8910f10>
2025-12-02 10:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_2.jpg HTTP/1.1" 201 0
2025-12-02 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2252704-9999999-335124545-001.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-001.jpg saved to cache
2025-12-02 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c
2025-12-02 10:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8dcf710>
2025-12-02 10:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_2.jpg HTTP/1.1" 201 0
2025-12-02 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b36675d-ed13-48f1-8320-ca36411bdf70_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_6.jpg saved to cache
2025-12-02 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1636bef3-09f3-50b8-8ff7-dc154055d704
2025-12-02 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdab41d7a-9a61-4e71-bd2b-daecfce2b3fe_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_4.jpg not downloaded yet
2025-12-02 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_4.jpg not downloaded yet
2025-12-02 10:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf5eb90>
2025-12-02 10:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_3.jpg HTTP/1.1" 201 0
2025-12-02 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2252704-9999999-335124545-002.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-002.jpg saved to cache
2025-12-02 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c
2025-12-02 10:02:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c, skipping ID generation
2025-12-02 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c from tracking dictionaries
2025-12-02 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c sending to next pipeline
2025-12-02 10:02:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c, identifier: 2252704
2025-12-02 10:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4caab72390>
2025-12-02 10:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_3.jpg HTTP/1.1" 201 0
2025-12-02 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252FImg-daec6989-9eb4-477c-a4ed-2bd508705567.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/Img-daec6989-9eb4-477c-a4ed-2bd508705567.jpg saved to cache
2025-12-02 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 31c0caf2-0773-541d-b1c7-db18adc292da
2025-12-02 10:02:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31c0caf2-0773-541d-b1c7-db18adc292da, skipping ID generation
2025-12-02 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 31c0caf2-0773-541d-b1c7-db18adc292da from tracking dictionaries
2025-12-02 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31c0caf2-0773-541d-b1c7-db18adc292da sending to next pipeline
2025-12-02 10:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 31c0caf2-0773-541d-b1c7-db18adc292da, identifier: 2577653
2025-12-02 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdab41d7a-9a61-4e71-bd2b-daecfce2b3fe_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_11.jpg not downloaded yet
2025-12-02 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_11.jpg not downloaded yet
2025-12-02 10:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c with identifier: 2252704
2025-12-02 10:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 10:02:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=SILVER HTTP/1.1" 200 None
2025-12-02 10:02:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 10:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c with identifier: 2252704
2025-12-02 10:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 27, 'seller_name': 'lookers', 'price_includes_vat': False, 'title': 'ford focus 1.5 tdci 120 zetec 5dr', 'price': 0, 'currency': 'gbp', 'make': 'ford', 'model': 'focus', 'transmission': 'manual', 'engine': '1.5l', 'fuel_type': 'diesel', 'odometer': 127989, 'odometer_reading_unit': 'mi', 'registration_date': '2016-11-28', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/ford/focus?id=2252704', 'location': 'washington', 'origin_country_code': 'gb', 'trim': '1.5 tdci 120 zetec 5dr', 'license_plate': 'lm66fue', 'year': 2016, 'listing': 'auction', 'c_o_2_emission_value': 99, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002252704-01986325-003.pdf', 'expiration_date': '2025-12-03t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_expert_report_file_e940bf99-e77a-428c-8263-1664c933a6da.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 296433}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-008.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 230406}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 217022}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 293849}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 278020}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 252639}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-006.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 231431}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-007.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 295010}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-009.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 254630}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-010.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 178668}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-011.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 176211}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-012.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 257661}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-13.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 428128}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1000.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 437918}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1001.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 293227}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1002.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 300930}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1003.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 474644}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1004.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 422879}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1005.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 230963}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1006.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 192844}], 'current_year_diff': 9, 'age_in_months': 108, 'make_model': 'ford focus', 'sanitized_make': 'ford', 'odometer_in_km': 205977}
Failed validating None in schema:
False
On instance:
{'age_in_months': 108,
'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_expert_report_file_e940bf99-e77a-428c-8263-1664c933a6da.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002252704-01986325-003.pdf',
'color': 'silver',
'currency': 'gbp',
'current_year_diff': 9,
'engine': '1.5l',
'expiration_date': '2025-12-03t09:00:00z',
'fuel_type': 'diesel',
'id': '0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'lm66fue',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/ford/focus?id=2252704',
'listing': 'auction',
'location': 'washington',
'make': 'ford',
'make_model': 'ford focus',
'model': 'focus',
'odometer': 127989,
'odometer_in_km': 205977,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296433,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 230406,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-008.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217022,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293849,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 278020,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252639,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-005.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 231431,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-006.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295010,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-007.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 254630,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-009.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 178668,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-010.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176211,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-011.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257661,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-012.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428128,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-13.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 437918,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1000.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293227,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1001.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300930,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1002.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 474644,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1003.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422879,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1004.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 230963,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1005.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192844,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1006.jpg',
'Width': 1500}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-28',
'sanitized_make': 'ford',
'seller_name': 'lookers',
'title': 'ford focus 1.5 tdci 120 zetec 5dr',
'transmission': 'manual',
'trim': '1.5 tdci 120 zetec 5dr',
'year': 2016}
2025-12-02 10:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c spider: manheim.gb
2025-12-02 10:02:32 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 27, 'seller_name': 'lookers', 'price_includes_vat': False, 'title': 'ford focus 1.5 tdci 120 zetec 5dr', 'price': 0, 'currency': 'gbp', 'make': 'ford', 'model': 'focus', 'transmission': 'manual', 'engine': '1.5l', 'fuel_type': 'diesel', 'odometer': 127989, 'odometer_reading_unit': 'mi', 'registration_date': '2016-11-28', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/ford/focus?id=2252704', 'location': 'washington', 'origin_country_code': 'gb', 'trim': '1.5 tdci 120 zetec 5dr', 'license_plate': 'lm66fue', 'year': 2016, 'listing': 'auction', 'c_o_2_emission_value': 99, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002252704-01986325-003.pdf', 'expiration_date': '2025-12-03t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_expert_report_file_e940bf99-e77a-428c-8263-1664c933a6da.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 296433}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-008.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 230406}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 217022}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 293849}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 278020}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 252639}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-006.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 231431}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-007.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 295010}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-009.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 254630}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-010.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 178668}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-011.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 176211}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-012.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 257661}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-13.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 428128}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1000.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 437918}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1001.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 293227}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1002.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 300930}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1003.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 474644}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1004.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 422879}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1005.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 230963}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1006.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 192844}], 'current_year_diff': 9, 'age_in_months': 108, 'make_model': 'ford focus', 'sanitized_make': 'ford', 'odometer_in_km': 205977}
Failed validating None in schema:
False
On instance:
{'age_in_months': 108,
'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_expert_report_file_e940bf99-e77a-428c-8263-1664c933a6da.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002252704-01986325-003.pdf',
'color': 'silver',
'currency': 'gbp',
'current_year_diff': 9,
'engine': '1.5l',
'expiration_date': '2025-12-03t09:00:00z',
'fuel_type': 'diesel',
'id': '0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'lm66fue',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/ford/focus?id=2252704',
'listing': 'auction',
'location': 'washington',
'make': 'ford',
'make_model': 'ford focus',
'model': 'focus',
'odometer': 127989,
'odometer_in_km': 205977,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296433,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 230406,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-008.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217022,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293849,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 278020,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252639,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-005.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 231431,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-006.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295010,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-007.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 254630,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-009.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 178668,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-010.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176211,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-011.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257661,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-012.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428128,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-13.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 437918,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1000.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293227,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1001.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300930,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1002.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 474644,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1003.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422879,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1004.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 230963,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1005.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192844,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1006.jpg',
'Width': 1500}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-28',
'sanitized_make': 'ford',
'seller_name': 'lookers',
'title': 'ford focus 1.5 tdci 120 zetec 5dr',
'transmission': 'manual',
'trim': '1.5 tdci 120 zetec 5dr',
'year': 2016}
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_expert_report_file_e940bf99-e77a-428c-8263-1664c933a6da.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002252704-01986325-003.pdf',
'color': 'SILVER',
'currency': 'GBP',
'engine': '1.5L',
'expiration_date': '2025-12-03T09:00:00Z',
'fuel_type': 'Diesel',
'id': '0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LM66FUE',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=2252704',
'listing': 'auction',
'location': 'Washington',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 127989,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296433,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 230406,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-008.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217022,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293849,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 278020,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252639,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-005.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 231431,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-006.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295010,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-007.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 254630,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-009.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 178668,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-010.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176211,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-011.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257661,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2252704-9999999-335124545-012.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428128,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-13.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 437918,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1000.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293227,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1001.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300930,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1002.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 474644,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1003.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422879,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1004.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 230963,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1005.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c/0bc4cdc0-cc14-5a2f-a67d-c39e4962dd5c_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192844,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2252704-4003448-1006.jpg',
'Width': 1500}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-28',
'seller_name': 'Lookers',
'title': 'FORD FOCUS 1.5 TDCi 120 Zetec 5dr',
'transmission': 'manual',
'trim': '1.5 TDCi 120 Zetec 5dr',
'year': 2016}
2025-12-02 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272252704%27 HTTP/1.1" 200 None
2025-12-02 10:02:32 [manheim.gb] INFO: Saving data for 2252704: {'created_time': 1764669752.714918, 'last_price_update_time': 1764669752.714931, 'auction_closing_time': 1764752400.0}
2025-12-02 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2252704') HTTP/1.1" 204 0
2025-12-02 10:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 31c0caf2-0773-541d-b1c7-db18adc292da with identifier: 2577653
2025-12-02 10:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 10:02:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=RED+AND+BLACK HTTP/1.1" 200 None
2025-12-02 10:02:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 10:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 31c0caf2-0773-541d-b1c7-db18adc292da with identifier: 2577653
2025-12-02 10:02:33 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 31c0caf2-0773-541d-b1c7-db18adc292da with identifier: 2577653 to the API
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 10:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/Img-daec6989-9eb4-477c-a4ed-2bd508705567.jpg>
{'auction_title': '',
'c_o_2_emission_value': 106,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_expert_report_file_3502bfa9-89ad-41dc-87d6-0f70df06523c.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002577653-01989447-001.pdf',
'color': 'RED AND BLACK',
'currency': 'GBP',
'engine': '1.5L',
'expiration_date': '2025-12-10T09:00:00Z',
'fuel_type': 'Diesel',
'id': '31c0caf2-0773-541d-b1c7-db18adc292da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HV20EKL',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/RENAULT/CAPTUR?id=2577653',
'listing': 'auction',
'location': 'Birmingham',
'make': 'RENAULT',
'model': 'CAPTUR',
'odometer': 60347,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 147222,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-824cdc5e-158a-4ddd-a0ef-81348518c250.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 230967,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261419,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-f55a4504-4901-4415-9afe-a867bc31a94e.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335441,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-daec6989-9eb4-477c-a4ed-2bd508705567.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 200571,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-039de38f-be5e-43a7-99eb-480e1a5fb4cf.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 146574,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-f4b602c6-adcb-4173-9f8f-bc1d6232e39e.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139140,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/Img-c9d9d256-2e22-4f04-a281-9a631e57aca4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 190641,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 202340,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 235845,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188594,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 206145,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196064,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b624f9af-13ab-45df-a5d7-a6ad7c6ae5b5_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290493,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2577653-4004161-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 246487,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2577653-4004161-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 164338,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2577653-4004161-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 183720,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2577653-4004161-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 183942,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2577653-4004161-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 243017,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2577653-4004161-1004.jpg',
'Width': 749},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c0caf2-0773-541d-b1c7-db18adc292da/31c0caf2-0773-541d-b1c7-db18adc292da_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176255,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2577653-4004161-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-09',
'seller_name': 'Hilton Garage Ltd',
'title': 'RENAULT CAPTUR 1.5 dCi 95 S Edition 5dr',
'transmission': 'manual',
'trim': '1.5 dCi 95 S Edition 5dr',
'year': 2020}
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272577653%27 HTTP/1.1" 200 None
2025-12-02 10:02:33 [manheim.gb] INFO: Saving data for 2577653: {'created_time': 1764669753.284253, 'last_price_update_time': 1764669753.284262, 'auction_closing_time': 1765357200.0}
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2577653') HTTP/1.1" 204 0
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdab41d7a-9a61-4e71-bd2b-daecfce2b3fe_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_10.jpg not downloaded yet
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_10.jpg not downloaded yet
2025-12-02 10:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/GRANDC4PICASSO?id=2660446&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232660446&indx=158> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdab41d7a-9a61-4e71-bd2b-daecfce2b3fe_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_9.jpg not downloaded yet
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_9.jpg not downloaded yet
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_2.jpg not downloaded yet
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_2.jpg not downloaded yet
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_5.jpg not downloaded yet
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_5.jpg not downloaded yet
2025-12-02 10:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002407950-01986793-002.pdf> (referer: None)
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_3.jpg not downloaded yet
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_3.jpg not downloaded yet
2025-12-02 10:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f7dfe2a-7581-5021-af0a-ac80d728d074 with identifier: 2660446
2025-12-02 10:02:33 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1f7dfe2a-7581-5021-af0a-ac80d728d074
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_4.jpg not downloaded yet
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_4.jpg not downloaded yet
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2616439-4003208-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2616439-4003208-13.jpg not downloaded yet
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2358676-4003744-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2358676-4003744-13.jpg not downloaded yet
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2616439-4003208-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2616439-4003208-1000.jpg not downloaded yet
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2358676-4003744-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2358676-4003744-1000.jpg not downloaded yet
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2616439-4003208-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2616439-4003208-1001.jpg not downloaded yet
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2358676-4003744-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2358676-4003744-1001.jpg not downloaded yet
2025-12-02 10:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90d4d90>
2025-12-02 10:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_expert_report_file_c59edab9-5131-490f-ae72-cb36f4fcc434.pdf HTTP/1.1" 201 0
2025-12-02 10:02:33 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9c7b23d3-2d65-54db-9f4c-4b1609f74249
2025-12-02 10:02:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c7b23d3-2d65-54db-9f4c-4b1609f74249, skipping ID generation
2025-12-02 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 9c7b23d3-2d65-54db-9f4c-4b1609f74249
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_7.jpg not downloaded yet
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2616439-4003208-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2616439-4003208-1002.jpg not downloaded yet
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2358676-4003744-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2358676-4003744-1002.jpg not downloaded yet
2025-12-02 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_7.jpg not downloaded yet
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2616439-4003208-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2616439-4003208-1003.jpg not downloaded yet
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2358676-4003744-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2358676-4003744-1003.jpg not downloaded yet
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_6.jpg not downloaded yet
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2616439-4003208-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2616439-4003208-1004.jpg not downloaded yet
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2358676-4003744-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2358676-4003744-1004.jpg not downloaded yet
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_1.jpg not downloaded yet
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2616439-4003208-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2616439-4003208-1005.jpg not downloaded yet
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2358676-4003744-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2358676-4003744-1005.jpg not downloaded yet
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1c94a72b-49d5-46db-a12f-af76c2ddd2a1_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_5.jpg not downloaded yet
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1c94a72b-49d5-46db-a12f-af76c2ddd2a1_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_4.jpg not downloaded yet
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1c94a72b-49d5-46db-a12f-af76c2ddd2a1_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_11.jpg not downloaded yet
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1c94a72b-49d5-46db-a12f-af76c2ddd2a1_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_10.jpg not downloaded yet
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1c94a72b-49d5-46db-a12f-af76c2ddd2a1_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_9.jpg not downloaded yet
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_2.jpg not downloaded yet
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_5.jpg not downloaded yet
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_3.jpg not downloaded yet
2025-12-02 10:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002642791-01989602-002.pdf> (referer: None)
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_4.jpg not downloaded yet
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2407950-4003085-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2407950-4003085-13.jpg not downloaded yet
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2407950-4003085-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2407950-4003085-1000.jpg not downloaded yet
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2407950-4003085-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2407950-4003085-1001.jpg not downloaded yet
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2407950-4003085-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2407950-4003085-1002.jpg not downloaded yet
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2407950-4003085-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2407950-4003085-1003.jpg not downloaded yet
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2407950-4003085-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2407950-4003085-1004.jpg not downloaded yet
2025-12-02 10:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8dd7050>
2025-12-02 10:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_expert_report_file_29791e0f-2b15-4e54-ad33-09f8269e6cc1.pdf HTTP/1.1" 201 0
2025-12-02 10:02:34 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item eb926208-3f8e-5995-916f-1443a266be67
2025-12-02 10:02:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb926208-3f8e-5995-916f-1443a266be67, skipping ID generation
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item eb926208-3f8e-5995-916f-1443a266be67
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_7.jpg not downloaded yet
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2407950-4003085-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2407950-4003085-1005.jpg not downloaded yet
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_7.jpg not downloaded yet
2025-12-02 10:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002407950-01986793-002.pdf)
2025-12-02 10:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002407950-01986793-002.pdf)
2025-12-02 10:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2358676-4003744-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002358676-01989476-002.pdf)
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_6.jpg not downloaded yet
2025-12-02 10:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2616439-4003208-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002616439-01987815-003.pdf)
2025-12-02 10:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2616439-4003208-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002616439-01987815-003.pdf)
2025-12-02 10:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002407950-01986793-002.pdf)
2025-12-02 10:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002407950-01986793-002.pdf)
2025-12-02 10:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2358676-4003744-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002358676-01989476-002.pdf)
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_1.jpg not downloaded yet
2025-12-02 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_5.jpg not downloaded yet
2025-12-02 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_4.jpg not downloaded yet
2025-12-02 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_11.jpg not downloaded yet
2025-12-02 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_10.jpg not downloaded yet
2025-12-02 10:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b0b3190>
2025-12-02 10:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_4.jpg HTTP/1.1" 201 0
2025-12-02 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1c94a72b-49d5-46db-a12f-af76c2ddd2a1_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_5.jpg saved to cache
2025-12-02 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c7b23d3-2d65-54db-9f4c-4b1609f74249
2025-12-02 10:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8e97a10>
2025-12-02 10:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_5.jpg HTTP/1.1" 201 0
2025-12-02 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1c94a72b-49d5-46db-a12f-af76c2ddd2a1_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_4.jpg saved to cache
2025-12-02 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9c7b23d3-2d65-54db-9f4c-4b1609f74249
2025-12-02 10:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8e72350>
2025-12-02 10:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_18.jpg HTTP/1.1" 201 0
2025-12-02 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2358676-4003744-1004.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2358676-4003744-1004.jpg saved to cache
2025-12-02 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item d0a60891-85d9-52bc-bc6a-9475f7562d0e
2025-12-02 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_9.jpg not downloaded yet
2025-12-02 10:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b637390>
2025-12-02 10:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_18.jpg HTTP/1.1" 201 0
2025-12-02 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2616439-4003208-1004.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2616439-4003208-1004.jpg saved to cache
2025-12-02 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 5ad5f07d-7d59-5c97-b50e-8854e5959ba6
2025-12-02 10:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6418d0>
2025-12-02 10:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_19.jpg HTTP/1.1" 201 0
2025-12-02 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2616439-4003208-1005.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2616439-4003208-1005.jpg saved to cache
2025-12-02 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 5ad5f07d-7d59-5c97-b50e-8854e5959ba6
2025-12-02 10:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6c4110>
2025-12-02 10:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_3.jpg HTTP/1.1" 201 0
2025-12-02 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_1.jpg saved to cache
2025-12-02 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c7b23d3-2d65-54db-9f4c-4b1609f74249
2025-12-02 10:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90b8fd0>
2025-12-02 10:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_2.jpg HTTP/1.1" 201 0
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_6.jpg saved to cache
2025-12-02 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c7b23d3-2d65-54db-9f4c-4b1609f74249
2025-12-02 10:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf79090>
2025-12-02 10:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_19.jpg HTTP/1.1" 201 0
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2358676-4003744-1005.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2358676-4003744-1005.jpg saved to cache
2025-12-02 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item d0a60891-85d9-52bc-bc6a-9475f7562d0e
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_2.jpg not downloaded yet
2025-12-02 10:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2358676-4003744-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002358676-01989476-002.pdf)
2025-12-02 10:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002407950-01986793-002.pdf)
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_5.jpg not downloaded yet
2025-12-02 10:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2616439-4003208-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002616439-01987815-003.pdf)
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_3.jpg not downloaded yet
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_4.jpg not downloaded yet
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2642791-4003754-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2642791-4003754-13.jpg not downloaded yet
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2642791-4003754-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2642791-4003754-1000.jpg not downloaded yet
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2642791-4003754-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2642791-4003754-1001.jpg not downloaded yet
2025-12-02 10:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ea1f50>
2025-12-02 10:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_17.jpg HTTP/1.1" 201 0
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2358676-4003744-1003.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2358676-4003744-1003.jpg saved to cache
2025-12-02 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item d0a60891-85d9-52bc-bc6a-9475f7562d0e
2025-12-02 10:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ef9010>
2025-12-02 10:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_1.jpg HTTP/1.1" 201 0
2025-12-02 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_7.jpg saved to cache
2025-12-02 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c7b23d3-2d65-54db-9f4c-4b1609f74249
2025-12-02 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2642791-4003754-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2642791-4003754-1002.jpg not downloaded yet
2025-12-02 10:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca88c1990>
2025-12-02 10:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_17.jpg HTTP/1.1" 201 0
2025-12-02 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2616439-4003208-1003.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2616439-4003208-1003.jpg saved to cache
2025-12-02 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 5ad5f07d-7d59-5c97-b50e-8854e5959ba6
2025-12-02 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2642791-4003754-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2642791-4003754-1003.jpg not downloaded yet
2025-12-02 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002642791-01989602-002.pdf)
2025-12-02 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002642791-01989602-002.pdf)
2025-12-02 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002642791-01989602-002.pdf)
2025-12-02 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002642791-01989602-002.pdf)
2025-12-02 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002642791-01989602-002.pdf)
2025-12-02 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002642791-01989602-002.pdf)
2025-12-02 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002642791-01989602-002.pdf)
2025-12-02 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002642791-01989602-002.pdf)
2025-12-02 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2642791-4003754-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2642791-4003754-1004.jpg not downloaded yet
2025-12-02 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2642791-4003754-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2642791-4003754-1005.jpg not downloaded yet
2025-12-02 10:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf5e2d0>
2025-12-02 10:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 10:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_3.jpg HTTP/1.1" 201 0
2025-12-02 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_1.jpg saved to cache
2025-12-02 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb926208-3f8e-5995-916f-1443a266be67
2025-12-02 10:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca901d810>
2025-12-02 10:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_7.jpg HTTP/1.1" 201 0
2025-12-02 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_10.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_10.jpg saved to cache
2025-12-02 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb926208-3f8e-5995-916f-1443a266be67
2025-12-02 10:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b0aea90>
2025-12-02 10:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_5.jpg HTTP/1.1" 201 0
2025-12-02 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_4.jpg saved to cache
2025-12-02 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb926208-3f8e-5995-916f-1443a266be67
2025-12-02 10:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8e96cd0>
2025-12-02 10:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_6.jpg HTTP/1.1" 201 0
2025-12-02 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_11.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_11.jpg saved to cache
2025-12-02 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb926208-3f8e-5995-916f-1443a266be67
2025-12-02 10:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfcddd0>
2025-12-02 10:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_8.jpg HTTP/1.1" 201 0
2025-12-02 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_9.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_9.jpg saved to cache
2025-12-02 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb926208-3f8e-5995-916f-1443a266be67
2025-12-02 10:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfcc9d0>
2025-12-02 10:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_4.jpg HTTP/1.1" 201 0
2025-12-02 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_5.jpg saved to cache
2025-12-02 10:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb926208-3f8e-5995-916f-1443a266be67
2025-12-02 10:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90c2290>
2025-12-02 10:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_2.jpg HTTP/1.1" 201 0
2025-12-02 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_6.jpg saved to cache
2025-12-02 10:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb926208-3f8e-5995-916f-1443a266be67
2025-12-02 10:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6e3b90>
2025-12-02 10:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_1.jpg HTTP/1.1" 201 0
2025-12-02 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_7.jpg saved to cache
2025-12-02 10:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb926208-3f8e-5995-916f-1443a266be67
2025-12-02 10:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002642791-01989602-002.pdf)
2025-12-02 10:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002642791-01989602-002.pdf)
2025-12-02 10:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2642791-4003754-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002642791-01989602-002.pdf)
2025-12-02 10:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002642791-01989602-002.pdf)
2025-12-02 10:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2642791-4003754-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002642791-01989602-002.pdf)
2025-12-02 10:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2407950-4003085-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002407950-01986793-002.pdf)
2025-12-02 10:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2642791-4003754-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002642791-01989602-002.pdf)
2025-12-02 10:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2642791-4003754-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002642791-01989602-002.pdf)
2025-12-02 10:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfcdd10>
2025-12-02 10:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_10.jpg HTTP/1.1" 201 0
2025-12-02 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_5.jpg saved to cache
2025-12-02 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item eb926208-3f8e-5995-916f-1443a266be67
2025-12-02 10:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8f62b50>
2025-12-02 10:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_0.jpg HTTP/1.1" 201 0
2025-12-02 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_7.jpg saved to cache
2025-12-02 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb926208-3f8e-5995-916f-1443a266be67
2025-12-02 10:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8f62550>
2025-12-02 10:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_18.jpg HTTP/1.1" 201 0
2025-12-02 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2642791-4003754-1004.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2642791-4003754-1004.jpg saved to cache
2025-12-02 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item eb926208-3f8e-5995-916f-1443a266be67
2025-12-02 10:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf8df10>
2025-12-02 10:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_9.jpg HTTP/1.1" 201 0
2025-12-02 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_2.jpg saved to cache
2025-12-02 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eb926208-3f8e-5995-916f-1443a266be67
2025-12-02 10:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf5a4d0>
2025-12-02 10:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_19.jpg HTTP/1.1" 201 0
2025-12-02 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2642791-4003754-1005.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2642791-4003754-1005.jpg saved to cache
2025-12-02 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item eb926208-3f8e-5995-916f-1443a266be67
2025-12-02 10:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfb1f90>
2025-12-02 10:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_19.jpg HTTP/1.1" 201 0
2025-12-02 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2407950-4003085-1005.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2407950-4003085-1005.jpg saved to cache
2025-12-02 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 9c7b23d3-2d65-54db-9f4c-4b1609f74249
2025-12-02 10:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6b3150>
2025-12-02 10:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_16.jpg HTTP/1.1" 201 0
2025-12-02 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2642791-4003754-1002.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2642791-4003754-1002.jpg saved to cache
2025-12-02 10:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item eb926208-3f8e-5995-916f-1443a266be67
2025-12-02 10:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca911f750>
2025-12-02 10:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_17.jpg HTTP/1.1" 201 0
2025-12-02 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2642791-4003754-1003.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2642791-4003754-1003.jpg saved to cache
2025-12-02 10:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item eb926208-3f8e-5995-916f-1443a266be67
2025-12-02 10:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002642791-01989602-002.pdf)
2025-12-02 10:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2642791-4003754-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002642791-01989602-002.pdf)
2025-12-02 10:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2407950-4003085-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002407950-01986793-002.pdf)
2025-12-02 10:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2642791-4003754-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002642791-01989602-002.pdf)
2025-12-02 10:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002642791-01989602-002.pdf)
2025-12-02 10:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2407950-4003085-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002407950-01986793-002.pdf)
2025-12-02 10:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2642791-4003754-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002642791-01989602-002.pdf)
2025-12-02 10:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2407950-4003085-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002407950-01986793-002.pdf)
2025-12-02 10:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90b2050>
2025-12-02 10:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_11.jpg HTTP/1.1" 201 0
2025-12-02 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_3.jpg saved to cache
2025-12-02 10:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item eb926208-3f8e-5995-916f-1443a266be67
2025-12-02 10:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8d67d50>
2025-12-02 10:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_14.jpg HTTP/1.1" 201 0
2025-12-02 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2642791-4003754-1000.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2642791-4003754-1000.jpg saved to cache
2025-12-02 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item eb926208-3f8e-5995-916f-1443a266be67
2025-12-02 10:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca88d7510>
2025-12-02 10:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_16.jpg HTTP/1.1" 201 0
2025-12-02 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2407950-4003085-1002.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2407950-4003085-1002.jpg saved to cache
2025-12-02 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 9c7b23d3-2d65-54db-9f4c-4b1609f74249
2025-12-02 10:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf70610>
2025-12-02 10:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_15.jpg HTTP/1.1" 201 0
2025-12-02 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2642791-4003754-1001.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2642791-4003754-1001.jpg saved to cache
2025-12-02 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item eb926208-3f8e-5995-916f-1443a266be67
2025-12-02 10:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8e53110>
2025-12-02 10:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_12.jpg HTTP/1.1" 201 0
2025-12-02 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_4.jpg saved to cache
2025-12-02 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item eb926208-3f8e-5995-916f-1443a266be67
2025-12-02 10:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8da2d10>
2025-12-02 10:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_18.jpg HTTP/1.1" 201 0
2025-12-02 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2407950-4003085-1004.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2407950-4003085-1004.jpg saved to cache
2025-12-02 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 9c7b23d3-2d65-54db-9f4c-4b1609f74249
2025-12-02 10:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8dcf8d0>
2025-12-02 10:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_13.jpg HTTP/1.1" 201 0
2025-12-02 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2642791-4003754-13.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2642791-4003754-13.jpg saved to cache
2025-12-02 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item eb926208-3f8e-5995-916f-1443a266be67
2025-12-02 10:02:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb926208-3f8e-5995-916f-1443a266be67, skipping ID generation
2025-12-02 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item eb926208-3f8e-5995-916f-1443a266be67 from tracking dictionaries
2025-12-02 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb926208-3f8e-5995-916f-1443a266be67 sending to next pipeline
2025-12-02 10:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: eb926208-3f8e-5995-916f-1443a266be67, identifier: 2642791
2025-12-02 10:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfcf690>
2025-12-02 10:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_17.jpg HTTP/1.1" 201 0
2025-12-02 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2407950-4003085-1003.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2407950-4003085-1003.jpg saved to cache
2025-12-02 10:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 9c7b23d3-2d65-54db-9f4c-4b1609f74249
2025-12-02 10:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002407950-01986793-002.pdf)
2025-12-02 10:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002407950-01986793-002.pdf)
2025-12-02 10:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: eb926208-3f8e-5995-916f-1443a266be67 with identifier: 2642791
2025-12-02 10:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: eb926208-3f8e-5995-916f-1443a266be67 with identifier: 2642791
2025-12-02 10:02:46 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: eb926208-3f8e-5995-916f-1443a266be67 with expiration date: 2025-12-02T09:00:00Z
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_expert_report_file_29791e0f-2b15-4e54-ad33-09f8269e6cc1.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002642791-01989602-002.pdf',
'color': 'BLACK',
'currency': 'GBP',
'engine': '1.4L',
'expiration_date': '2025-12-02T09:00:00Z',
'fuel_type': 'Petrol',
'id': 'eb926208-3f8e-5995-916f-1443a266be67',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CV61MVS',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/SEAT/IBIZA?id=2642791',
'listing': 'auction',
'location': 'Northampton',
'make': 'SEAT',
'model': 'IBIZA',
'odometer': 108389,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 33,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220295,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220295,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 254282,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 185977,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 208228,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 209660,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216757,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 213979,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 213860,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280690,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196216,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 202027,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 262774,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cdbb9c61-2d17-4fc0-9e73-30dd1b4a33f3_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345972,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2642791-4003754-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273257,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2642791-4003754-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285412,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2642791-4003754-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339359,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2642791-4003754-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354860,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2642791-4003754-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 229100,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2642791-4003754-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb926208-3f8e-5995-916f-1443a266be67/eb926208-3f8e-5995-916f-1443a266be67_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315383,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2642791-4003754-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-05',
'seller_name': 'Sytner',
'title': 'SEAT IBIZA 1.4 SE Copa 3dr',
'transmission': 'manual',
'trim': '1.4 SE Copa 3dr',
'year': 2011}
2025-12-02 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272642791%27 HTTP/1.1" 200 None
2025-12-02 10:02:46 [manheim.gb] INFO: Saving data for 2642791: {'created_time': 1764669766.61456, 'last_price_update_time': 1764669766.61457, 'auction_closing_time': 1764666000.0}
2025-12-02 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2642791') HTTP/1.1" 204 0
2025-12-02 10:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2407950-4003085-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002407950-01986793-002.pdf)
2025-12-02 10:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002407950-01986793-002.pdf)
2025-12-02 10:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002407950-01986793-002.pdf)
2025-12-02 10:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002407950-01986793-002.pdf)
2025-12-02 10:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2407950-4003085-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002407950-01986793-002.pdf)
2025-12-02 10:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/NOTE?id=2321815&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232321815&indx=118> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2407950-4003085-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002407950-01986793-002.pdf)
2025-12-02 10:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8d72750>
2025-12-02 10:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_11.jpg HTTP/1.1" 201 0
2025-12-02 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_3.jpg saved to cache
2025-12-02 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9c7b23d3-2d65-54db-9f4c-4b1609f74249
2025-12-02 10:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8d59410>
2025-12-02 10:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_8.jpg HTTP/1.1" 201 0
2025-12-02 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1c94a72b-49d5-46db-a12f-af76c2ddd2a1_9.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_9.jpg saved to cache
2025-12-02 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9c7b23d3-2d65-54db-9f4c-4b1609f74249
2025-12-02 10:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002407950-01986793-002.pdf)
2025-12-02 10:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002407950-01986793-002.pdf)
2025-12-02 10:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002407950-01986793-002.pdf)
2025-12-02 10:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2358676-4003744-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002358676-01989476-002.pdf)
2025-12-02 10:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2358676-4003744-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002358676-01989476-002.pdf)
2025-12-02 10:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2358676-4003744-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002358676-01989476-002.pdf)
2025-12-02 10:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2616439-4003208-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002616439-01987815-003.pdf)
2025-12-02 10:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6b3150>
2025-12-02 10:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_15.jpg HTTP/1.1" 201 0
2025-12-02 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2407950-4003085-1001.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2407950-4003085-1001.jpg saved to cache
2025-12-02 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 9c7b23d3-2d65-54db-9f4c-4b1609f74249
2025-12-02 10:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf59910>
2025-12-02 10:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_10.jpg HTTP/1.1" 201 0
2025-12-02 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_5.jpg saved to cache
2025-12-02 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9c7b23d3-2d65-54db-9f4c-4b1609f74249
2025-12-02 10:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfb3b10>
2025-12-02 10:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 10:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_12.jpg HTTP/1.1" 201 0
2025-12-02 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_4.jpg saved to cache
2025-12-02 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9c7b23d3-2d65-54db-9f4c-4b1609f74249
2025-12-02 10:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8e82e10>
2025-12-02 10:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_9.jpg HTTP/1.1" 201 0
2025-12-02 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_2.jpg saved to cache
2025-12-02 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9c7b23d3-2d65-54db-9f4c-4b1609f74249
2025-12-02 10:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca911fa90>
2025-12-02 10:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_14.jpg HTTP/1.1" 201 0
2025-12-02 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2407950-4003085-1000.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2407950-4003085-1000.jpg saved to cache
2025-12-02 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 9c7b23d3-2d65-54db-9f4c-4b1609f74249
2025-12-02 10:02:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1 with identifier: 2321815
2025-12-02 10:02:48 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1
2025-12-02 10:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf8f550>
2025-12-02 10:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_13.jpg HTTP/1.1" 201 0
2025-12-02 10:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2407950-4003085-13.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2407950-4003085-13.jpg saved to cache
2025-12-02 10:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9c7b23d3-2d65-54db-9f4c-4b1609f74249
2025-12-02 10:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2616439-4003208-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002616439-01987815-003.pdf)
2025-12-02 10:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2616439-4003208-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002616439-01987815-003.pdf)
2025-12-02 10:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002358676-01989476-002.pdf)
2025-12-02 10:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002616439-01987815-003.pdf)
2025-12-02 10:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8dd6c10>
2025-12-02 10:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_7.jpg HTTP/1.1" 201 0
2025-12-02 10:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1c94a72b-49d5-46db-a12f-af76c2ddd2a1_10.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_10.jpg saved to cache
2025-12-02 10:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9c7b23d3-2d65-54db-9f4c-4b1609f74249
2025-12-02 10:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca88d6bd0>
2025-12-02 10:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_6.jpg HTTP/1.1" 201 0
2025-12-02 10:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1c94a72b-49d5-46db-a12f-af76c2ddd2a1_11.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_11.jpg saved to cache
2025-12-02 10:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9c7b23d3-2d65-54db-9f4c-4b1609f74249
2025-12-02 10:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf5e0d0>
2025-12-02 10:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_0.jpg HTTP/1.1" 201 0
2025-12-02 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_7.jpg saved to cache
2025-12-02 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c7b23d3-2d65-54db-9f4c-4b1609f74249
2025-12-02 10:02:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c7b23d3-2d65-54db-9f4c-4b1609f74249, skipping ID generation
2025-12-02 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9c7b23d3-2d65-54db-9f4c-4b1609f74249 from tracking dictionaries
2025-12-02 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c7b23d3-2d65-54db-9f4c-4b1609f74249 sending to next pipeline
2025-12-02 10:02:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 9c7b23d3-2d65-54db-9f4c-4b1609f74249, identifier: 2407950
2025-12-02 10:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8d59d50>
2025-12-02 10:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 10:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_16.jpg HTTP/1.1" 201 0
2025-12-02 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2358676-4003744-1002.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2358676-4003744-1002.jpg saved to cache
2025-12-02 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item d0a60891-85d9-52bc-bc6a-9475f7562d0e
2025-12-02 10:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90abbd0>
2025-12-02 10:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 10:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_14.jpg HTTP/1.1" 201 0
2025-12-02 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2358676-4003744-1000.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2358676-4003744-1000.jpg saved to cache
2025-12-02 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item d0a60891-85d9-52bc-bc6a-9475f7562d0e
2025-12-02 10:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8d8a910>
2025-12-02 10:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_15.jpg HTTP/1.1" 201 0
2025-12-02 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2358676-4003744-1001.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2358676-4003744-1001.jpg saved to cache
2025-12-02 10:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item d0a60891-85d9-52bc-bc6a-9475f7562d0e
2025-12-02 10:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf58510>
2025-12-02 10:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_15.jpg HTTP/1.1" 201 0
2025-12-02 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2616439-4003208-1001.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2616439-4003208-1001.jpg saved to cache
2025-12-02 10:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 5ad5f07d-7d59-5c97-b50e-8854e5959ba6
2025-12-02 10:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2616439-4003208-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002616439-01987815-003.pdf)
2025-12-02 10:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2358676-4003744-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002358676-01989476-002.pdf)
2025-12-02 10:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 9c7b23d3-2d65-54db-9f4c-4b1609f74249 with identifier: 2407950
2025-12-02 10:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 10:02:51 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Grey HTTP/1.1" 200 None
2025-12-02 10:02:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 10:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 9c7b23d3-2d65-54db-9f4c-4b1609f74249 with identifier: 2407950
2025-12-02 10:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 9c7b23d3-2d65-54db-9f4c-4b1609f74249 with identifier: 2407950 to the API
2025-12-02 10:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 10:02:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 10:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_expert_report_file_c59edab9-5131-490f-ae72-cb36f4fcc434.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002407950-01986793-002.pdf',
'color': 'Grey',
'currency': 'GBP',
'engine': '2.0L',
'expiration_date': '2025-12-09T09:00:00Z',
'fuel_type': 'Petrol',
'id': '9c7b23d3-2d65-54db-9f4c-4b1609f74249',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RE17ZXN',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/Q5?id=2407950',
'listing': 'auction',
'location': 'Colchester',
'make': 'AUDI',
'model': 'Q5',
'odometer': 66754,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182436,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182436,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 243325,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 200232,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 178467,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 173569,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182272,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184981,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192400,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 267497,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 235876,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154021,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260004,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1c94a72b-49d5-46db-a12f-af76c2ddd2a1_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369463,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2407950-4003085-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279500,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2407950-4003085-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 215096,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2407950-4003085-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318925,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2407950-4003085-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 460136,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2407950-4003085-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361626,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2407950-4003085-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7b23d3-2d65-54db-9f4c-4b1609f74249/9c7b23d3-2d65-54db-9f4c-4b1609f74249_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334182,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2407950-4003085-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-15',
'seller_name': 'Lookers',
'title': 'AUDI Q5 2.0T FSI Quattro S Line 5dr S Tronic',
'transmission': 'automatic',
'trim': '2.0T FSI Quattro S Line 5dr S Tronic',
'year': 2017}
2025-12-02 10:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272407950%27 HTTP/1.1" 200 None
2025-12-02 10:02:52 [manheim.gb] INFO: Saving data for 2407950: {'created_time': 1764669772.727267, 'last_price_update_time': 1764669772.72728, 'auction_closing_time': 1765270800.0}
2025-12-02 10:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2407950') HTTP/1.1" 204 0
2025-12-02 10:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002358676-01989476-002.pdf)
2025-12-02 10:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002358676-01989476-002.pdf)
2025-12-02 10:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf64890>
2025-12-02 10:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_16.jpg HTTP/1.1" 201 0
2025-12-02 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2616439-4003208-1002.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2616439-4003208-1002.jpg saved to cache
2025-12-02 10:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 5ad5f07d-7d59-5c97-b50e-8854e5959ba6
2025-12-02 10:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6b2710>
2025-12-02 10:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_14.jpg HTTP/1.1" 201 0
2025-12-02 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2616439-4003208-1000.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2616439-4003208-1000.jpg saved to cache
2025-12-02 10:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 5ad5f07d-7d59-5c97-b50e-8854e5959ba6
2025-12-02 10:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca9013bd0>
2025-12-02 10:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_12.jpg HTTP/1.1" 201 0
2025-12-02 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_4.jpg saved to cache
2025-12-02 10:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item d0a60891-85d9-52bc-bc6a-9475f7562d0e
2025-12-02 10:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90c3550>
2025-12-02 10:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_12.jpg HTTP/1.1" 201 0
2025-12-02 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_4.jpg saved to cache
2025-12-02 10:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 5ad5f07d-7d59-5c97-b50e-8854e5959ba6
2025-12-02 10:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8d88090>
2025-12-02 10:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_13.jpg HTTP/1.1" 201 0
2025-12-02 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2616439-4003208-13.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2616439-4003208-13.jpg saved to cache
2025-12-02 10:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 5ad5f07d-7d59-5c97-b50e-8854e5959ba6
2025-12-02 10:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6dfe50>
2025-12-02 10:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_13.jpg HTTP/1.1" 201 0
2025-12-02 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2358676-4003744-13.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2358676-4003744-13.jpg saved to cache
2025-12-02 10:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item d0a60891-85d9-52bc-bc6a-9475f7562d0e
2025-12-02 10:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002616439-01987815-003.pdf)
2025-12-02 10:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002616439-01987815-003.pdf)
2025-12-02 10:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002358676-01989476-002.pdf)
2025-12-02 10:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002616439-01987815-003.pdf)
2025-12-02 10:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002616439-01987815-003.pdf)
2025-12-02 10:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002358676-01989476-002.pdf)
2025-12-02 10:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfcb850>
2025-12-02 10:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 10:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_10.jpg HTTP/1.1" 201 0
2025-12-02 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_5.jpg saved to cache
2025-12-02 10:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item d0a60891-85d9-52bc-bc6a-9475f7562d0e
2025-12-02 10:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca901cbd0>
2025-12-02 10:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_11.jpg HTTP/1.1" 201 0
2025-12-02 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_3.jpg saved to cache
2025-12-02 10:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item d0a60891-85d9-52bc-bc6a-9475f7562d0e
2025-12-02 10:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf7e010>
2025-12-02 10:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_11.jpg HTTP/1.1" 201 0
2025-12-02 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_3.jpg saved to cache
2025-12-02 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 5ad5f07d-7d59-5c97-b50e-8854e5959ba6
2025-12-02 10:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bff3a50>
2025-12-02 10:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_10.jpg HTTP/1.1" 201 0
2025-12-02 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_5.jpg saved to cache
2025-12-02 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 5ad5f07d-7d59-5c97-b50e-8854e5959ba6
2025-12-02 10:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6a7390>
2025-12-02 10:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_9.jpg HTTP/1.1" 201 0
2025-12-02 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_2.jpg saved to cache
2025-12-02 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d0a60891-85d9-52bc-bc6a-9475f7562d0e
2025-12-02 10:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b0ae790>
2025-12-02 10:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_9.jpg HTTP/1.1" 201 0
2025-12-02 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_2.jpg saved to cache
2025-12-02 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5ad5f07d-7d59-5c97-b50e-8854e5959ba6
2025-12-02 10:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002616439-01987815-003.pdf)
2025-12-02 10:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002616439-01987815-003.pdf)
2025-12-02 10:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002616439-01987815-003.pdf)
2025-12-02 10:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8f09550>
2025-12-02 10:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_8.jpg HTTP/1.1" 201 0
2025-12-02 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdab41d7a-9a61-4e71-bd2b-daecfce2b3fe_9.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_9.jpg saved to cache
2025-12-02 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5ad5f07d-7d59-5c97-b50e-8854e5959ba6
2025-12-02 10:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf59650>
2025-12-02 10:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_8.jpg HTTP/1.1" 201 0
2025-12-02 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_9.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_9.jpg saved to cache
2025-12-02 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d0a60891-85d9-52bc-bc6a-9475f7562d0e
2025-12-02 10:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002358676-01989476-002.pdf)
2025-12-02 10:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002358676-01989476-002.pdf)
2025-12-02 10:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002358676-01989476-002.pdf)
2025-12-02 10:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002358676-01989476-002.pdf)
2025-12-02 10:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/ASTRA?id=2698793&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232698793&indx=165> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002616439-01987815-003.pdf)
2025-12-02 10:02:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:02:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca88cf5d0>
2025-12-02 10:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_7.jpg HTTP/1.1" 201 0
2025-12-02 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdab41d7a-9a61-4e71-bd2b-daecfce2b3fe_10.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_10.jpg saved to cache
2025-12-02 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5ad5f07d-7d59-5c97-b50e-8854e5959ba6
2025-12-02 10:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca9135890>
2025-12-02 10:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_6.jpg HTTP/1.1" 201 0
2025-12-02 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdab41d7a-9a61-4e71-bd2b-daecfce2b3fe_11.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_11.jpg saved to cache
2025-12-02 10:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5ad5f07d-7d59-5c97-b50e-8854e5959ba6
2025-12-02 10:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90b2610>
2025-12-02 10:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_5.jpg HTTP/1.1" 201 0
2025-12-02 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdab41d7a-9a61-4e71-bd2b-daecfce2b3fe_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_4.jpg saved to cache
2025-12-02 10:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5ad5f07d-7d59-5c97-b50e-8854e5959ba6
2025-12-02 10:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4caa706b50>
2025-12-02 10:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_5.jpg HTTP/1.1" 201 0
2025-12-02 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_4.jpg saved to cache
2025-12-02 10:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d0a60891-85d9-52bc-bc6a-9475f7562d0e
2025-12-02 10:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6ee8d0>
2025-12-02 10:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_6.jpg HTTP/1.1" 201 0
2025-12-02 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_11.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_11.jpg saved to cache
2025-12-02 10:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d0a60891-85d9-52bc-bc6a-9475f7562d0e
2025-12-02 10:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6ee050>
2025-12-02 10:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_7.jpg HTTP/1.1" 201 0
2025-12-02 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_10.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_10.jpg saved to cache
2025-12-02 10:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d0a60891-85d9-52bc-bc6a-9475f7562d0e
2025-12-02 10:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8d738d0>
2025-12-02 10:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_4.jpg HTTP/1.1" 201 0
2025-12-02 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_5.jpg saved to cache
2025-12-02 10:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d0a60891-85d9-52bc-bc6a-9475f7562d0e
2025-12-02 10:02:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8180215a-eabd-59d5-afd5-daac71f37d0c with identifier: 2698793
2025-12-02 10:02:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8180215a-eabd-59d5-afd5-daac71f37d0c
2025-12-02 10:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90d6190>
2025-12-02 10:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_4.jpg HTTP/1.1" 201 0
2025-12-02 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdab41d7a-9a61-4e71-bd2b-daecfce2b3fe_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_5.jpg saved to cache
2025-12-02 10:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5ad5f07d-7d59-5c97-b50e-8854e5959ba6
2025-12-02 10:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002616439-01987815-003.pdf)
2025-12-02 10:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002616439-01987815-003.pdf)
2025-12-02 10:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002358676-01989476-002.pdf)
2025-12-02 10:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002358676-01989476-002.pdf)
2025-12-02 10:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002616439-01987815-003.pdf)
2025-12-02 10:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002616439-01987815-003.pdf)
2025-12-02 10:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002358676-01989476-002.pdf)
2025-12-02 10:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002358676-01989476-002.pdf)
2025-12-02 10:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002660446-01985389-003.pdf> (referer: None)
2025-12-02 10:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002321815-01987253-002.pdf> (referer: None)
2025-12-02 10:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ebf390>
2025-12-02 10:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_1.jpg HTTP/1.1" 201 0
2025-12-02 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_7.jpg saved to cache
2025-12-02 10:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5ad5f07d-7d59-5c97-b50e-8854e5959ba6
2025-12-02 10:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90310d0>
2025-12-02 10:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_0.jpg HTTP/1.1" 201 0
2025-12-02 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_7.jpg saved to cache
2025-12-02 10:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5ad5f07d-7d59-5c97-b50e-8854e5959ba6
2025-12-02 10:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255783-01985373-002.pdf)
2025-12-02 10:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255783-01985373-002.pdf)
2025-12-02 10:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca9203710>
2025-12-02 10:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 10:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_3.jpg HTTP/1.1" 201 0
2025-12-02 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 10:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_1.jpg saved to cache
2025-12-02 10:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d0a60891-85d9-52bc-bc6a-9475f7562d0e
2025-12-02 10:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf71ad0>
2025-12-02 10:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_2.jpg HTTP/1.1" 201 0
2025-12-02 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_6.jpg saved to cache
2025-12-02 10:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d0a60891-85d9-52bc-bc6a-9475f7562d0e
2025-12-02 10:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf54610>
2025-12-02 10:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_3.jpg HTTP/1.1" 201 0
2025-12-02 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_1.jpg saved to cache
2025-12-02 10:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5ad5f07d-7d59-5c97-b50e-8854e5959ba6
2025-12-02 10:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf65f50>
2025-12-02 10:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_2.jpg HTTP/1.1" 201 0
2025-12-02 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_6.jpg saved to cache
2025-12-02 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5ad5f07d-7d59-5c97-b50e-8854e5959ba6
2025-12-02 10:03:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5ad5f07d-7d59-5c97-b50e-8854e5959ba6, skipping ID generation
2025-12-02 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5ad5f07d-7d59-5c97-b50e-8854e5959ba6 from tracking dictionaries
2025-12-02 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5ad5f07d-7d59-5c97-b50e-8854e5959ba6 sending to next pipeline
2025-12-02 10:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 5ad5f07d-7d59-5c97-b50e-8854e5959ba6, identifier: 2616439
2025-12-02 10:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfcd9d0>
2025-12-02 10:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_1.jpg HTTP/1.1" 201 0
2025-12-02 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_7.jpg saved to cache
2025-12-02 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d0a60891-85d9-52bc-bc6a-9475f7562d0e
2025-12-02 10:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ede4d0>
2025-12-02 10:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_0.jpg HTTP/1.1" 201 0
2025-12-02 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_7.jpg saved to cache
2025-12-02 10:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d0a60891-85d9-52bc-bc6a-9475f7562d0e
2025-12-02 10:03:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d0a60891-85d9-52bc-bc6a-9475f7562d0e, skipping ID generation
2025-12-02 10:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d0a60891-85d9-52bc-bc6a-9475f7562d0e from tracking dictionaries
2025-12-02 10:03:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d0a60891-85d9-52bc-bc6a-9475f7562d0e sending to next pipeline
2025-12-02 10:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: d0a60891-85d9-52bc-bc6a-9475f7562d0e, identifier: 2358676
2025-12-02 10:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf7f990>
2025-12-02 10:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_expert_report_file_c3ebda8e-2f72-4395-854c-012b50544d60.pdf HTTP/1.1" 201 0
2025-12-02 10:03:02 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1f7dfe2a-7581-5021-af0a-ac80d728d074
2025-12-02 10:03:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f7dfe2a-7581-5021-af0a-ac80d728d074, skipping ID generation
2025-12-02 10:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item 1f7dfe2a-7581-5021-af0a-ac80d728d074
2025-12-02 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4291a8f3-7524-4bf3-b94d-65394501548c_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_7.jpg not downloaded yet
2025-12-02 10:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b636190>
2025-12-02 10:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_expert_report_file_6f239cf3-065a-4d3d-8910-3d014aec9187.pdf HTTP/1.1" 201 0
2025-12-02 10:03:03 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1
2025-12-02 10:03:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1, skipping ID generation
2025-12-02 10:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1
2025-12-02 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2321815-9999999-335132727-004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-004.jpg not downloaded yet
2025-12-02 10:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 5ad5f07d-7d59-5c97-b50e-8854e5959ba6 with identifier: 2616439
2025-12-02 10:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 5ad5f07d-7d59-5c97-b50e-8854e5959ba6 with identifier: 2616439
2025-12-02 10:03:03 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 5ad5f07d-7d59-5c97-b50e-8854e5959ba6 with identifier: 2616439 to the API
2025-12-02 10:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 10:03:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 10:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_expert_report_file_7e396dba-99ef-4ba3-b6b5-3d3819b7b76d.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002616439-01987815-003.pdf',
'color': 'White',
'currency': 'GBP',
'engine': '1.2L',
'expiration_date': '2025-12-04T09:00:00Z',
'fuel_type': 'Petrol',
'id': '5ad5f07d-7d59-5c97-b50e-8854e5959ba6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YP67WEF',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FIAT/500?id=2616439',
'listing': 'auction',
'location': 'Colchester',
'make': 'FIAT',
'model': '500',
'odometer': 47795,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186841,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186841,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245328,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199487,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184091,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179099,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186635,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184135,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188191,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295464,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300750,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316307,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 231904,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dab41d7a-9a61-4e71-bd2b-daecfce2b3fe_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300884,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2616439-4003208-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121835,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2616439-4003208-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 244506,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2616439-4003208-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344286,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2616439-4003208-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347369,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2616439-4003208-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 228281,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2616439-4003208-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad5f07d-7d59-5c97-b50e-8854e5959ba6/5ad5f07d-7d59-5c97-b50e-8854e5959ba6_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196918,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2616439-4003208-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-26',
'seller_name': 'Big Motoring World Ltd',
'title': 'FIAT 500 1.2 Lounge 3dr',
'transmission': 'manual',
'trim': '1.2 Lounge 3dr',
'year': 2017}
2025-12-02 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272616439%27 HTTP/1.1" 200 None
2025-12-02 10:03:03 [manheim.gb] INFO: Saving data for 2616439: {'created_time': 1764669783.655349, 'last_price_update_time': 1764669783.655362, 'auction_closing_time': 1764838800.0}
2025-12-02 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2616439') HTTP/1.1" 204 0
2025-12-02 10:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: d0a60891-85d9-52bc-bc6a-9475f7562d0e with identifier: 2358676
2025-12-02 10:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: d0a60891-85d9-52bc-bc6a-9475f7562d0e with identifier: 2358676
2025-12-02 10:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 173076 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
173076
2025-12-02 10:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d0a60891-85d9-52bc-bc6a-9475f7562d0e spider: manheim.gb
2025-12-02 10:03:03 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: d0a60891-85d9-52bc-bc6a-9475f7562d0e due to rule: high_mileage_for_country.json, error: 173076 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
173076
{'auction_title': '',
'c_o_2_emission_value': 143,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_expert_report_file_55886fed-6b62-4f00-bf32-a80e408f5882.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002358676-01989476-002.pdf',
'color': 'SILVER',
'currency': 'GBP',
'engine': '1.6L',
'expiration_date': '2025-12-03T09:00:00Z',
'fuel_type': 'Diesel',
'id': 'd0a60891-85d9-52bc-bc6a-9475f7562d0e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PY65BYR',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/X-TRAIL?id=2358676',
'listing': 'auction',
'location': 'Plymouth',
'make': 'NISSAN',
'model': 'X-TRAIL',
'odometer': 107545,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 37,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220892,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220892,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 243505,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198832,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220590,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217477,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 213873,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 207706,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 218106,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 226296,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220155,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216808,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252539,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/90c8814b-b7e5-46c7-8f15-0ac0e20e54b6_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314850,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2358676-4003744-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 156992,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2358676-4003744-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 141411,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2358676-4003744-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180571,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2358676-4003744-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 134818,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2358676-4003744-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187917,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2358676-4003744-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0a60891-85d9-52bc-bc6a-9475f7562d0e/d0a60891-85d9-52bc-bc6a-9475f7562d0e_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322575,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2358676-4003744-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-29',
'seller_name': 'Yeomans',
'title': 'NISSAN X-TRAIL 1.6 dCi N-Tec 5dr 4WD [7 Seat]',
'transmission': 'manual',
'trim': '1.6 dCi N-Tec 5dr 4WD [7 Seat]',
'year': 2015}
2025-12-02 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272358676%27 HTTP/1.1" 200 None
2025-12-02 10:03:03 [manheim.gb] INFO: Saving data for 2358676: {'created_time': 1764669783.908732, 'last_price_update_time': 1764669783.908744, 'auction_closing_time': 1764752400.0}
2025-12-02 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2358676') HTTP/1.1" 204 0
2025-12-02 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4291a8f3-7524-4bf3-b94d-65394501548c_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_7.jpg not downloaded yet
2025-12-02 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2321815-9999999-335132727-008.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-008.jpg not downloaded yet
2025-12-02 10:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=2837848&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232837848&indx=188> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:03:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4291a8f3-7524-4bf3-b94d-65394501548c_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_6.jpg not downloaded yet
2025-12-02 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2321815-9999999-335132727-001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-001.jpg not downloaded yet
2025-12-02 10:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8def010>
2025-12-02 10:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_0.jpg HTTP/1.1" 201 0
2025-12-02 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b36675d-ed13-48f1-8320-ca36411bdf70_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_7.jpg saved to cache
2025-12-02 10:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1636bef3-09f3-50b8-8ff7-dc154055d704
2025-12-02 10:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf7e050>
2025-12-02 10:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_1.jpg HTTP/1.1" 201 0
2025-12-02 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b36675d-ed13-48f1-8320-ca36411bdf70_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_7.jpg saved to cache
2025-12-02 10:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1636bef3-09f3-50b8-8ff7-dc154055d704
2025-12-02 10:03:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1636bef3-09f3-50b8-8ff7-dc154055d704, skipping ID generation
2025-12-02 10:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1636bef3-09f3-50b8-8ff7-dc154055d704 from tracking dictionaries
2025-12-02 10:03:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1636bef3-09f3-50b8-8ff7-dc154055d704 sending to next pipeline
2025-12-02 10:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 1636bef3-09f3-50b8-8ff7-dc154055d704, identifier: 2255783
2025-12-02 10:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 1636bef3-09f3-50b8-8ff7-dc154055d704 with identifier: 2255783
2025-12-02 10:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 1636bef3-09f3-50b8-8ff7-dc154055d704 with identifier: 2255783
2025-12-02 10:03:04 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 1636bef3-09f3-50b8-8ff7-dc154055d704 with identifier: 2255783 to the API
2025-12-02 10:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 10:03:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 10:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 127,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_expert_report_file_a95356ae-1792-42af-9d65-f6126b1ef916.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002255783-01985373-002.pdf',
'color': 'RED',
'currency': 'GBP',
'engine': '2.0L',
'expiration_date': '2025-12-04T09:00:00Z',
'fuel_type': 'Diesel',
'id': '1636bef3-09f3-50b8-8ff7-dc154055d704',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KN68ZPT',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C4%20GRAND%20SPACETOURER?id=2255783',
'listing': 'auction',
'location': 'Northampton',
'make': 'CITROEN',
'model': 'C4 GRAND SPACETOURER',
'odometer': 75399,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 251805,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 251805,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261181,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180645,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 234600,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 240031,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239228,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237648,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252158,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294664,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253606,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 251490,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 256852,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b36675d-ed13-48f1-8320-ca36411bdf70_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328797,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255783-4003462-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394523,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255783-4003462-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 404774,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255783-4003462-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338277,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255783-4003462-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 215897,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255783-4003462-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293121,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255783-4003462-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1636bef3-09f3-50b8-8ff7-dc154055d704/1636bef3-09f3-50b8-8ff7-dc154055d704_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 205637,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255783-4003462-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-28',
'seller_name': 'Sycamore',
'title': 'CITROEN C4 GRAND SPACETOURER 2.0 BlueHDi 160 Flair 5dr EAT8',
'transmission': 'automatic',
'trim': '2.0 BlueHDi 160 Flair 5dr EAT8',
'year': 2018}
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272255783%27 HTTP/1.1" 200 None
2025-12-02 10:03:05 [manheim.gb] INFO: Saving data for 2255783: {'created_time': 1764669785.103879, 'last_price_update_time': 1764669785.10389, 'auction_closing_time': 1764838800.0}
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2255783') HTTP/1.1" 204 0
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4291a8f3-7524-4bf3-b94d-65394501548c_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_1.jpg not downloaded yet
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2321815-9999999-335132727-002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-002.jpg not downloaded yet
2025-12-02 10:03:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff3e908d-aa6d-52b2-97e3-da51e8cd4c48 with identifier: 2837848
2025-12-02 10:03:05 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ff3e908d-aa6d-52b2-97e3-da51e8cd4c48
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4291a8f3-7524-4bf3-b94d-65394501548c_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_5.jpg not downloaded yet
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2321815-9999999-335132727-003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-003.jpg not downloaded yet
2025-12-02 10:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002660446-01985389-003.pdf)
2025-12-02 10:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002321815-01987253-002.pdf)
2025-12-02 10:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002660446-01985389-003.pdf)
2025-12-02 10:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-008.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002321815-01987253-002.pdf)
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4291a8f3-7524-4bf3-b94d-65394501548c_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_4.jpg not downloaded yet
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2321815-9999999-335132727-005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-005.jpg not downloaded yet
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4291a8f3-7524-4bf3-b94d-65394501548c_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_11.jpg not downloaded yet
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2321815-9999999-335132727-006.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-006.jpg not downloaded yet
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4291a8f3-7524-4bf3-b94d-65394501548c_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_10.jpg not downloaded yet
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2321815-9999999-335132727-007.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-007.jpg not downloaded yet
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4291a8f3-7524-4bf3-b94d-65394501548c_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_9.jpg not downloaded yet
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2321815-9999999-335132727-009.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-009.jpg not downloaded yet
2025-12-02 10:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6bfb90>
2025-12-02 10:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_0.jpg HTTP/1.1" 201 0
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4291a8f3-7524-4bf3-b94d-65394501548c_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_7.jpg saved to cache
2025-12-02 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f7dfe2a-7581-5021-af0a-ac80d728d074
2025-12-02 10:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b609350>
2025-12-02 10:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_0.jpg HTTP/1.1" 201 0
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2321815-9999999-335132727-004.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-004.jpg saved to cache
2025-12-02 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1
2025-12-02 10:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90b2190>
2025-12-02 10:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_1.jpg HTTP/1.1" 201 0
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4291a8f3-7524-4bf3-b94d-65394501548c_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_7.jpg saved to cache
2025-12-02 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1f7dfe2a-7581-5021-af0a-ac80d728d074
2025-12-02 10:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf863d0>
2025-12-02 10:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_1.jpg HTTP/1.1" 201 0
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2321815-9999999-335132727-008.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-008.jpg saved to cache
2025-12-02 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4291a8f3-7524-4bf3-b94d-65394501548c_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_2.jpg not downloaded yet
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2321815-9999999-335132727-010.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-010.jpg not downloaded yet
2025-12-02 10:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002698793-01985331-001.pdf> (referer: None)
2025-12-02 10:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002321815-01987253-002.pdf)
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4291a8f3-7524-4bf3-b94d-65394501548c_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_5.jpg not downloaded yet
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2321815-9999999-335132727-011.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-011.jpg not downloaded yet
2025-12-02 10:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002660446-01985389-003.pdf)
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4291a8f3-7524-4bf3-b94d-65394501548c_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_3.jpg not downloaded yet
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2321815-9999999-335132727-012.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-012.jpg not downloaded yet
2025-12-02 10:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002321815-01987253-002.pdf)
2025-12-02 10:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002321815-01987253-002.pdf)
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4291a8f3-7524-4bf3-b94d-65394501548c_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_4.jpg not downloaded yet
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2321815-4003575-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-13.jpg not downloaded yet
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2660446-4003506-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2660446-4003506-13.jpg not downloaded yet
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2321815-4003575-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1000.jpg not downloaded yet
2025-12-02 10:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8dcd010>
2025-12-02 10:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_expert_report_file_5f59878f-08f1-4d80-8941-8379429da6d5.pdf HTTP/1.1" 201 0
2025-12-02 10:03:07 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8180215a-eabd-59d5-afd5-daac71f37d0c
2025-12-02 10:03:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8180215a-eabd-59d5-afd5-daac71f37d0c, skipping ID generation
2025-12-02 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 8180215a-eabd-59d5-afd5-daac71f37d0c
2025-12-02 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60c0a941-4931-4d75-a343-0d8f739c36f4_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_7.jpg not downloaded yet
2025-12-02 10:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca88cf750>
2025-12-02 10:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_2.jpg HTTP/1.1" 201 0
2025-12-02 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2321815-9999999-335132727-001.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-001.jpg saved to cache
2025-12-02 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1
2025-12-02 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2660446-4003506-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2660446-4003506-1000.jpg not downloaded yet
2025-12-02 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2321815-4003575-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1001.jpg not downloaded yet
2025-12-02 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60c0a941-4931-4d75-a343-0d8f739c36f4_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_7.jpg not downloaded yet
2025-12-02 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2660446-4003506-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2660446-4003506-1001.jpg not downloaded yet
2025-12-02 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2321815-4003575-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1002.jpg not downloaded yet
2025-12-02 10:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8f4c610>
2025-12-02 10:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_4.jpg HTTP/1.1" 201 0
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4291a8f3-7524-4bf3-b94d-65394501548c_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_5.jpg saved to cache
2025-12-02 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1f7dfe2a-7581-5021-af0a-ac80d728d074
2025-12-02 10:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6bcb50>
2025-12-02 10:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_4.jpg HTTP/1.1" 201 0
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2321815-9999999-335132727-003.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-003.jpg saved to cache
2025-12-02 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1
2025-12-02 10:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf243d0>
2025-12-02 10:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_3.jpg HTTP/1.1" 201 0
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2321815-9999999-335132727-002.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-002.jpg saved to cache
2025-12-02 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60c0a941-4931-4d75-a343-0d8f739c36f4_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_6.jpg not downloaded yet
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2660446-4003506-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2660446-4003506-1002.jpg not downloaded yet
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2321815-4003575-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1003.jpg not downloaded yet
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60c0a941-4931-4d75-a343-0d8f739c36f4_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_1.jpg not downloaded yet
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2660446-4003506-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2660446-4003506-1003.jpg not downloaded yet
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2321815-4003575-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1004.jpg not downloaded yet
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60c0a941-4931-4d75-a343-0d8f739c36f4_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_5.jpg not downloaded yet
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2660446-4003506-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2660446-4003506-1004.jpg not downloaded yet
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2321815-4003575-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1005.jpg not downloaded yet
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60c0a941-4931-4d75-a343-0d8f739c36f4_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_4.jpg not downloaded yet
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2321815-4003575-1006.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1006.jpg not downloaded yet
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60c0a941-4931-4d75-a343-0d8f739c36f4_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_11.jpg not downloaded yet
2025-12-02 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60c0a941-4931-4d75-a343-0d8f739c36f4_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_10.jpg not downloaded yet
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60c0a941-4931-4d75-a343-0d8f739c36f4_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_9.jpg not downloaded yet
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60c0a941-4931-4d75-a343-0d8f739c36f4_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_2.jpg not downloaded yet
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60c0a941-4931-4d75-a343-0d8f739c36f4_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_5.jpg not downloaded yet
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60c0a941-4931-4d75-a343-0d8f739c36f4_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_3.jpg not downloaded yet
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60c0a941-4931-4d75-a343-0d8f739c36f4_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_4.jpg not downloaded yet
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2698793-4003656-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2698793-4003656-13.jpg not downloaded yet
2025-12-02 10:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002143943-01982616-002.pdf> (referer: None)
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2698793-4003656-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2698793-4003656-1000.jpg not downloaded yet
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2698793-4003656-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2698793-4003656-1001.jpg not downloaded yet
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2698793-4003656-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2698793-4003656-1002.jpg not downloaded yet
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2698793-4003656-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2698793-4003656-1003.jpg not downloaded yet
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2698793-4003656-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2698793-4003656-1004.jpg not downloaded yet
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2698793-4003656-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2698793-4003656-1005.jpg not downloaded yet
2025-12-02 10:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90f3850>
2025-12-02 10:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_expert_report_file_8787023e-631d-409a-8655-0e4ee979a7b1.pdf HTTP/1.1" 201 0
2025-12-02 10:03:09 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c31f3c30-4a52-5772-a6f7-e4cfaf567d8b
2025-12-02 10:03:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c31f3c30-4a52-5772-a6f7-e4cfaf567d8b, skipping ID generation
2025-12-02 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item c31f3c30-4a52-5772-a6f7-e4cfaf567d8b
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ee2352e-7751-4296-ae84-88622e09ef25_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_7.jpg not downloaded yet
2025-12-02 10:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002837848-01987678-001.pdf> (referer: None)
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ee2352e-7751-4296-ae84-88622e09ef25_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_7.jpg not downloaded yet
2025-12-02 10:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001783769-01975507-003.pdf> (referer: None)
2025-12-02 10:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002698793-01985331-001.pdf)
2025-12-02 10:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002321815-01987253-002.pdf)
2025-12-02 10:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002698793-01985331-001.pdf)
2025-12-02 10:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002321815-01987253-002.pdf)
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ee2352e-7751-4296-ae84-88622e09ef25_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_6.jpg not downloaded yet
2025-12-02 10:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002698793-01985331-001.pdf)
2025-12-02 10:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2660446-4003506-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002660446-01985389-003.pdf)
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ee2352e-7751-4296-ae84-88622e09ef25_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_1.jpg not downloaded yet
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ee2352e-7751-4296-ae84-88622e09ef25_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_5.jpg not downloaded yet
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ee2352e-7751-4296-ae84-88622e09ef25_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_4.jpg not downloaded yet
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ee2352e-7751-4296-ae84-88622e09ef25_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_11.jpg not downloaded yet
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ee2352e-7751-4296-ae84-88622e09ef25_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_10.jpg not downloaded yet
2025-12-02 10:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf64150>
2025-12-02 10:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_expert_report_file_1a50cab1-c6ba-4285-9724-95efa142e62f.pdf HTTP/1.1" 201 0
2025-12-02 10:03:10 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ff3e908d-aa6d-52b2-97e3-da51e8cd4c48
2025-12-02 10:03:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff3e908d-aa6d-52b2-97e3-da51e8cd4c48, skipping ID generation
2025-12-02 10:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item ff3e908d-aa6d-52b2-97e3-da51e8cd4c48
2025-12-02 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F76248662-9f1a-42ff-835e-94c8f39bcc11_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_7.jpg not downloaded yet
2025-12-02 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ee2352e-7751-4296-ae84-88622e09ef25_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_9.jpg not downloaded yet
2025-12-02 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F76248662-9f1a-42ff-835e-94c8f39bcc11_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_7.jpg not downloaded yet
2025-12-02 10:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90fc210>
2025-12-02 10:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_expert_report_file_fe2f6a77-9638-488e-8e38-f1cc43ebf767.pdf HTTP/1.1" 201 0
2025-12-02 10:03:11 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f
2025-12-02 10:03:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f, skipping ID generation
2025-12-02 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f
2025-12-02 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_7.jpg not downloaded yet
2025-12-02 10:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf5f510>
2025-12-02 10:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_6.jpg HTTP/1.1" 201 0
2025-12-02 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60c0a941-4931-4d75-a343-0d8f739c36f4_11.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_11.jpg saved to cache
2025-12-02 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8180215a-eabd-59d5-afd5-daac71f37d0c
2025-12-02 10:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca9092ad0>
2025-12-02 10:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_19.jpg HTTP/1.1" 201 0
2025-12-02 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2321815-4003575-1006.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1006.jpg saved to cache
2025-12-02 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1
2025-12-02 10:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8f60f90>
2025-12-02 10:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_5.jpg HTTP/1.1" 201 0
2025-12-02 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60c0a941-4931-4d75-a343-0d8f739c36f4_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_4.jpg saved to cache
2025-12-02 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8180215a-eabd-59d5-afd5-daac71f37d0c
2025-12-02 10:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8f79290>
2025-12-02 10:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_18.jpg HTTP/1.1" 201 0
2025-12-02 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2321815-4003575-1005.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1005.jpg saved to cache
2025-12-02 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1
2025-12-02 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ee2352e-7751-4296-ae84-88622e09ef25_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_2.jpg not downloaded yet
2025-12-02 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F76248662-9f1a-42ff-835e-94c8f39bcc11_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_6.jpg not downloaded yet
2025-12-02 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_7.jpg not downloaded yet
2025-12-02 10:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca9202bd0>
2025-12-02 10:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_12.jpg HTTP/1.1" 201 0
2025-12-02 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60c0a941-4931-4d75-a343-0d8f739c36f4_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_4.jpg saved to cache
2025-12-02 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8180215a-eabd-59d5-afd5-daac71f37d0c
2025-12-02 10:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8d7f390>
2025-12-02 10:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_18.jpg HTTP/1.1" 201 0
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2660446-4003506-1004.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2660446-4003506-1004.jpg saved to cache
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 1f7dfe2a-7581-5021-af0a-ac80d728d074
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ee2352e-7751-4296-ae84-88622e09ef25_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_5.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F76248662-9f1a-42ff-835e-94c8f39bcc11_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_1.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_6.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ee2352e-7751-4296-ae84-88622e09ef25_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_3.jpg not downloaded yet
2025-12-02 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/POLO?id=2876443&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232876443&indx=194> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F76248662-9f1a-42ff-835e-94c8f39bcc11_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_5.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_1.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ee2352e-7751-4296-ae84-88622e09ef25_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_4.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F76248662-9f1a-42ff-835e-94c8f39bcc11_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_4.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F14b3134b-c28b-413b-bd6c-bf903dec36b2_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_5.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2143943-4002446-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2143943-4002446-13.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F76248662-9f1a-42ff-835e-94c8f39bcc11_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_11.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F14b3134b-c28b-413b-bd6c-bf903dec36b2_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_4.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2143943-4002446-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2143943-4002446-1000.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F76248662-9f1a-42ff-835e-94c8f39bcc11_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_10.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F14b3134b-c28b-413b-bd6c-bf903dec36b2_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_11.jpg not downloaded yet
2025-12-02 10:03:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 117adf7a-b7b1-53c5-b58b-649b58f53f7a with identifier: 2876443
2025-12-02 10:03:13 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 117adf7a-b7b1-53c5-b58b-649b58f53f7a
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2143943-4002446-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2143943-4002446-1001.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F76248662-9f1a-42ff-835e-94c8f39bcc11_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_9.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F14b3134b-c28b-413b-bd6c-bf903dec36b2_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_10.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2143943-4002446-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2143943-4002446-1002.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F76248662-9f1a-42ff-835e-94c8f39bcc11_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_2.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F14b3134b-c28b-413b-bd6c-bf903dec36b2_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_9.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2143943-4002446-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2143943-4002446-1003.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F76248662-9f1a-42ff-835e-94c8f39bcc11_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_5.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_2.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2143943-4002446-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2143943-4002446-1004.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F76248662-9f1a-42ff-835e-94c8f39bcc11_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_3.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_5.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2143943-4002446-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2143943-4002446-1005.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F76248662-9f1a-42ff-835e-94c8f39bcc11_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_4.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_3.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2837848-3991676-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2837848-3991676-13.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_4.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2837848-3991676-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2837848-3991676-1000.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1783769-3990966-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1783769-3990966-13.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2837848-3991676-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2837848-3991676-1001.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1783769-3990966-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1783769-3990966-1000.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2837848-3991676-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2837848-3991676-1002.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1783769-3990966-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1783769-3990966-1001.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2837848-3991676-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2837848-3991676-1003.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1783769-3990966-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1783769-3990966-1002.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2837848-3991676-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2837848-3991676-1004.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1783769-3990966-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1783769-3990966-1003.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2837848-3991676-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2837848-3991676-1005.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1783769-3990966-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1783769-3990966-1004.jpg not downloaded yet
2025-12-02 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1783769-3990966-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1783769-3990966-1005.jpg not downloaded yet
2025-12-02 10:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1783769-3990966-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001783769-01975507-003.pdf)
2025-12-02 10:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2837848-3991676-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002837848-01987678-001.pdf)
2025-12-02 10:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2837848-3991676-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002837848-01987678-001.pdf)
2025-12-02 10:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1783769-3990966-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001783769-01975507-003.pdf)
2025-12-02 10:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfb1250>
2025-12-02 10:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_15.jpg HTTP/1.1" 201 0
2025-12-02 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1783769-3990966-1001.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1783769-3990966-1001.jpg saved to cache
2025-12-02 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f
2025-12-02 10:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2837848-3991676-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002837848-01987678-001.pdf)
2025-12-02 10:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8e70b10>
2025-12-02 10:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_19.jpg HTTP/1.1" 201 0
2025-12-02 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2837848-3991676-1005.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2837848-3991676-1005.jpg saved to cache
2025-12-02 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item ff3e908d-aa6d-52b2-97e3-da51e8cd4c48
2025-12-02 10:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8e48f10>
2025-12-02 10:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_17.jpg HTTP/1.1" 201 0
2025-12-02 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2837848-3991676-1003.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2837848-3991676-1003.jpg saved to cache
2025-12-02 10:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item ff3e908d-aa6d-52b2-97e3-da51e8cd4c48
2025-12-02 10:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6410d0>
2025-12-02 10:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_16.jpg HTTP/1.1" 201 0
2025-12-02 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1783769-3990966-1002.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1783769-3990966-1002.jpg saved to cache
2025-12-02 10:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f
2025-12-02 10:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2837848-3991676-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002837848-01987678-001.pdf)
2025-12-02 10:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1783769-3990966-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001783769-01975507-003.pdf)
2025-12-02 10:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1783769-3990966-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001783769-01975507-003.pdf)
2025-12-02 10:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2837848-3991676-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002837848-01987678-001.pdf)
2025-12-02 10:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1783769-3990966-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001783769-01975507-003.pdf)
2025-12-02 10:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca892d2d0>
2025-12-02 10:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_18.jpg HTTP/1.1" 201 0
2025-12-02 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2837848-3991676-1004.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2837848-3991676-1004.jpg saved to cache
2025-12-02 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item ff3e908d-aa6d-52b2-97e3-da51e8cd4c48
2025-12-02 10:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1783769-3990966-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001783769-01975507-003.pdf)
2025-12-02 10:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2837848-3991676-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002837848-01987678-001.pdf)
2025-12-02 10:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1783769-3990966-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001783769-01975507-003.pdf)
2025-12-02 10:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001783769-01975507-003.pdf)
2025-12-02 10:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001783769-01975507-003.pdf)
2025-12-02 10:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8eea310>
2025-12-02 10:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_16.jpg HTTP/1.1" 201 0
2025-12-02 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2837848-3991676-1002.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2837848-3991676-1002.jpg saved to cache
2025-12-02 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item ff3e908d-aa6d-52b2-97e3-da51e8cd4c48
2025-12-02 10:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8da3e10>
2025-12-02 10:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_19.jpg HTTP/1.1" 201 0
2025-12-02 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1783769-3990966-1005.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1783769-3990966-1005.jpg saved to cache
2025-12-02 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f
2025-12-02 10:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf81490>
2025-12-02 10:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_17.jpg HTTP/1.1" 201 0
2025-12-02 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1783769-3990966-1003.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1783769-3990966-1003.jpg saved to cache
2025-12-02 10:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f
2025-12-02 10:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8912cd0>
2025-12-02 10:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_15.jpg HTTP/1.1" 201 0
2025-12-02 10:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2837848-3991676-1001.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2837848-3991676-1001.jpg saved to cache
2025-12-02 10:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item ff3e908d-aa6d-52b2-97e3-da51e8cd4c48
2025-12-02 10:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6e0250>
2025-12-02 10:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_18.jpg HTTP/1.1" 201 0
2025-12-02 10:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1783769-3990966-1004.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1783769-3990966-1004.jpg saved to cache
2025-12-02 10:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f
2025-12-02 10:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2837848-3991676-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002837848-01987678-001.pdf)
2025-12-02 10:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001783769-01975507-003.pdf)
2025-12-02 10:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002837848-01987678-001.pdf)
2025-12-02 10:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2143943-4002446-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002143943-01982616-002.pdf)
2025-12-02 10:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca88d7e90>
2025-12-02 10:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_13.jpg HTTP/1.1" 201 0
2025-12-02 10:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1783769-3990966-13.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1783769-3990966-13.jpg saved to cache
2025-12-02 10:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f
2025-12-02 10:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfcb250>
2025-12-02 10:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_14.jpg HTTP/1.1" 201 0
2025-12-02 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2837848-3991676-1000.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2837848-3991676-1000.jpg saved to cache
2025-12-02 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item ff3e908d-aa6d-52b2-97e3-da51e8cd4c48
2025-12-02 10:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf8af50>
2025-12-02 10:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_14.jpg HTTP/1.1" 201 0
2025-12-02 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1783769-3990966-1000.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1783769-3990966-1000.jpg saved to cache
2025-12-02 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f
2025-12-02 10:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf8e590>
2025-12-02 10:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_12.jpg HTTP/1.1" 201 0
2025-12-02 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_4.jpg saved to cache
2025-12-02 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f
2025-12-02 10:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90fd750>
2025-12-02 10:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_11.jpg HTTP/1.1" 201 0
2025-12-02 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_3.jpg saved to cache
2025-12-02 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f
2025-12-02 10:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002837848-01987678-001.pdf)
2025-12-02 10:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2143943-4002446-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002143943-01982616-002.pdf)
2025-12-02 10:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002837848-01987678-001.pdf)
2025-12-02 10:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001783769-01975507-003.pdf)
2025-12-02 10:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ffaa10>
2025-12-02 10:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_13.jpg HTTP/1.1" 201 0
2025-12-02 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2837848-3991676-13.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2837848-3991676-13.jpg saved to cache
2025-12-02 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ff3e908d-aa6d-52b2-97e3-da51e8cd4c48
2025-12-02 10:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf80b50>
2025-12-02 10:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 10:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_10.jpg HTTP/1.1" 201 0
2025-12-02 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_5.jpg saved to cache
2025-12-02 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f
2025-12-02 10:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b0a4590>
2025-12-02 10:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_11.jpg HTTP/1.1" 201 0
2025-12-02 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F76248662-9f1a-42ff-835e-94c8f39bcc11_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_3.jpg saved to cache
2025-12-02 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ff3e908d-aa6d-52b2-97e3-da51e8cd4c48
2025-12-02 10:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ebcd90>
2025-12-02 10:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_19.jpg HTTP/1.1" 201 0
2025-12-02 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2143943-4002446-1005.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2143943-4002446-1005.jpg saved to cache
2025-12-02 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item c31f3c30-4a52-5772-a6f7-e4cfaf567d8b
2025-12-02 10:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2143943-4002446-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002143943-01982616-002.pdf)
2025-12-02 10:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001783769-01975507-003.pdf)
2025-12-02 10:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001783769-01975507-003.pdf)
2025-12-02 10:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002837848-01987678-001.pdf)
2025-12-02 10:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf8d090>
2025-12-02 10:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 10:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_12.jpg HTTP/1.1" 201 0
2025-12-02 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F76248662-9f1a-42ff-835e-94c8f39bcc11_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_4.jpg saved to cache
2025-12-02 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ff3e908d-aa6d-52b2-97e3-da51e8cd4c48
2025-12-02 10:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90d53d0>
2025-12-02 10:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_18.jpg HTTP/1.1" 201 0
2025-12-02 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2143943-4002446-1004.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2143943-4002446-1004.jpg saved to cache
2025-12-02 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item c31f3c30-4a52-5772-a6f7-e4cfaf567d8b
2025-12-02 10:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6f4dd0>
2025-12-02 10:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_10.jpg HTTP/1.1" 201 0
2025-12-02 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F76248662-9f1a-42ff-835e-94c8f39bcc11_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_5.jpg saved to cache
2025-12-02 10:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ff3e908d-aa6d-52b2-97e3-da51e8cd4c48
2025-12-02 10:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8f23150>
2025-12-02 10:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 10:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_9.jpg HTTP/1.1" 201 0
2025-12-02 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_2.jpg saved to cache
2025-12-02 10:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f
2025-12-02 10:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002837848-01987678-001.pdf)
2025-12-02 10:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2143943-4002446-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002143943-01982616-002.pdf)
2025-12-02 10:03:21 [scrapy.extensions.logstats] INFO: Crawled 52 pages (at 21 pages/min), scraped 7 items (at 4 items/min)
2025-12-02 10:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001783769-01975507-003.pdf)
2025-12-02 10:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002837848-01987678-001.pdf)
2025-12-02 10:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf834d0>
2025-12-02 10:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_17.jpg HTTP/1.1" 201 0
2025-12-02 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2143943-4002446-1003.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2143943-4002446-1003.jpg saved to cache
2025-12-02 10:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item c31f3c30-4a52-5772-a6f7-e4cfaf567d8b
2025-12-02 10:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf87190>
2025-12-02 10:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_8.jpg HTTP/1.1" 201 0
2025-12-02 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F14b3134b-c28b-413b-bd6c-bf903dec36b2_9.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_9.jpg saved to cache
2025-12-02 10:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f
2025-12-02 10:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90a8ed0>
2025-12-02 10:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_7.jpg HTTP/1.1" 201 0
2025-12-02 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F14b3134b-c28b-413b-bd6c-bf903dec36b2_10.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_10.jpg saved to cache
2025-12-02 10:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f
2025-12-02 10:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6e1a90>
2025-12-02 10:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_8.jpg HTTP/1.1" 201 0
2025-12-02 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F76248662-9f1a-42ff-835e-94c8f39bcc11_9.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_9.jpg saved to cache
2025-12-02 10:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ff3e908d-aa6d-52b2-97e3-da51e8cd4c48
2025-12-02 10:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2143943-4002446-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002143943-01982616-002.pdf)
2025-12-02 10:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001783769-01975507-003.pdf)
2025-12-02 10:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001783769-01975507-003.pdf)
2025-12-02 10:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002837848-01987678-001.pdf)
2025-12-02 10:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b640b50>
2025-12-02 10:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_9.jpg HTTP/1.1" 201 0
2025-12-02 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F76248662-9f1a-42ff-835e-94c8f39bcc11_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_2.jpg saved to cache
2025-12-02 10:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ff3e908d-aa6d-52b2-97e3-da51e8cd4c48
2025-12-02 10:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8901050>
2025-12-02 10:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_16.jpg HTTP/1.1" 201 0
2025-12-02 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2143943-4002446-1002.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2143943-4002446-1002.jpg saved to cache
2025-12-02 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item c31f3c30-4a52-5772-a6f7-e4cfaf567d8b
2025-12-02 10:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8eddb50>
2025-12-02 10:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_6.jpg HTTP/1.1" 201 0
2025-12-02 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F14b3134b-c28b-413b-bd6c-bf903dec36b2_11.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_11.jpg saved to cache
2025-12-02 10:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f
2025-12-02 10:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8f0b090>
2025-12-02 10:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_7.jpg HTTP/1.1" 201 0
2025-12-02 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F76248662-9f1a-42ff-835e-94c8f39bcc11_10.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_10.jpg saved to cache
2025-12-02 10:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ff3e908d-aa6d-52b2-97e3-da51e8cd4c48
2025-12-02 10:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2143943-4002446-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002143943-01982616-002.pdf)
2025-12-02 10:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2143943-4002446-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002143943-01982616-002.pdf)
2025-12-02 10:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001783769-01975507-003.pdf)
2025-12-02 10:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002837848-01987678-001.pdf)
2025-12-02 10:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8fc7a10>
2025-12-02 10:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 10:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_15.jpg HTTP/1.1" 201 0
2025-12-02 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2143943-4002446-1001.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2143943-4002446-1001.jpg saved to cache
2025-12-02 10:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item c31f3c30-4a52-5772-a6f7-e4cfaf567d8b
2025-12-02 10:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca9004c50>
2025-12-02 10:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_4.jpg HTTP/1.1" 201 0
2025-12-02 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F14b3134b-c28b-413b-bd6c-bf903dec36b2_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_5.jpg saved to cache
2025-12-02 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f
2025-12-02 10:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfa8a90>
2025-12-02 10:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_5.jpg HTTP/1.1" 201 0
2025-12-02 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F14b3134b-c28b-413b-bd6c-bf903dec36b2_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_4.jpg saved to cache
2025-12-02 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f
2025-12-02 10:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf65dd0>
2025-12-02 10:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_6.jpg HTTP/1.1" 201 0
2025-12-02 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F76248662-9f1a-42ff-835e-94c8f39bcc11_11.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_11.jpg saved to cache
2025-12-02 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ff3e908d-aa6d-52b2-97e3-da51e8cd4c48
2025-12-02 10:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002143943-01982616-002.pdf)
2025-12-02 10:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002837848-01987678-001.pdf)
2025-12-02 10:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002143943-01982616-002.pdf)
2025-12-02 10:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002837848-01987678-001.pdf)
2025-12-02 10:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002143943-01982616-002.pdf)
2025-12-02 10:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8dee1d0>
2025-12-02 10:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_14.jpg HTTP/1.1" 201 0
2025-12-02 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2143943-4002446-1000.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2143943-4002446-1000.jpg saved to cache
2025-12-02 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item c31f3c30-4a52-5772-a6f7-e4cfaf567d8b
2025-12-02 10:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6a6450>
2025-12-02 10:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_13.jpg HTTP/1.1" 201 0
2025-12-02 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2143943-4002446-13.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2143943-4002446-13.jpg saved to cache
2025-12-02 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item c31f3c30-4a52-5772-a6f7-e4cfaf567d8b
2025-12-02 10:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca88cdcd0>
2025-12-02 10:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_3.jpg HTTP/1.1" 201 0
2025-12-02 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_1.jpg saved to cache
2025-12-02 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f
2025-12-02 10:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8903e10>
2025-12-02 10:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_5.jpg HTTP/1.1" 201 0
2025-12-02 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F76248662-9f1a-42ff-835e-94c8f39bcc11_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_4.jpg saved to cache
2025-12-02 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ff3e908d-aa6d-52b2-97e3-da51e8cd4c48
2025-12-02 10:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001783769-01975507-003.pdf)
2025-12-02 10:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001783769-01975507-003.pdf)
2025-12-02 10:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002837848-01987678-001.pdf)
2025-12-02 10:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002143943-01982616-002.pdf)
2025-12-02 10:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf6c110>
2025-12-02 10:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_12.jpg HTTP/1.1" 201 0
2025-12-02 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ee2352e-7751-4296-ae84-88622e09ef25_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_4.jpg saved to cache
2025-12-02 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item c31f3c30-4a52-5772-a6f7-e4cfaf567d8b
2025-12-02 10:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8f4efd0>
2025-12-02 10:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_4.jpg HTTP/1.1" 201 0
2025-12-02 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F76248662-9f1a-42ff-835e-94c8f39bcc11_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_5.jpg saved to cache
2025-12-02 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff3e908d-aa6d-52b2-97e3-da51e8cd4c48
2025-12-02 10:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90306d0>
2025-12-02 10:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_11.jpg HTTP/1.1" 201 0
2025-12-02 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ee2352e-7751-4296-ae84-88622e09ef25_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_3.jpg saved to cache
2025-12-02 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item c31f3c30-4a52-5772-a6f7-e4cfaf567d8b
2025-12-02 10:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6d2090>
2025-12-02 10:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_3.jpg HTTP/1.1" 201 0
2025-12-02 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F76248662-9f1a-42ff-835e-94c8f39bcc11_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_1.jpg saved to cache
2025-12-02 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ff3e908d-aa6d-52b2-97e3-da51e8cd4c48
2025-12-02 10:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf70090>
2025-12-02 10:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_10.jpg HTTP/1.1" 201 0
2025-12-02 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ee2352e-7751-4296-ae84-88622e09ef25_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_5.jpg saved to cache
2025-12-02 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item c31f3c30-4a52-5772-a6f7-e4cfaf567d8b
2025-12-02 10:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002143943-01982616-002.pdf)
2025-12-02 10:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002143943-01982616-002.pdf)
2025-12-02 10:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002837848-01987678-001.pdf)
2025-12-02 10:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002837848-01987678-001.pdf)
2025-12-02 10:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001783769-01975507-003.pdf)
2025-12-02 10:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6b3990>
2025-12-02 10:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_2.jpg HTTP/1.1" 201 0
2025-12-02 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_6.jpg saved to cache
2025-12-02 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f
2025-12-02 10:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8929f10>
2025-12-02 10:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_1.jpg HTTP/1.1" 201 0
2025-12-02 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_7.jpg saved to cache
2025-12-02 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f
2025-12-02 10:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ebe350>
2025-12-02 10:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_2.jpg HTTP/1.1" 201 0
2025-12-02 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F76248662-9f1a-42ff-835e-94c8f39bcc11_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_6.jpg saved to cache
2025-12-02 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ff3e908d-aa6d-52b2-97e3-da51e8cd4c48
2025-12-02 10:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf0e5d0>
2025-12-02 10:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_9.jpg HTTP/1.1" 201 0
2025-12-02 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ee2352e-7751-4296-ae84-88622e09ef25_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_2.jpg saved to cache
2025-12-02 10:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c31f3c30-4a52-5772-a6f7-e4cfaf567d8b
2025-12-02 10:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/BMW/1SERIES?id=2817812&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232817812&indx=186> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002143943-01982616-002.pdf)
2025-12-02 10:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002143943-01982616-002.pdf)
2025-12-02 10:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002143943-01982616-002.pdf)
2025-12-02 10:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8dd7410>
2025-12-02 10:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_8.jpg HTTP/1.1" 201 0
2025-12-02 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ee2352e-7751-4296-ae84-88622e09ef25_9.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_9.jpg saved to cache
2025-12-02 10:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c31f3c30-4a52-5772-a6f7-e4cfaf567d8b
2025-12-02 10:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8903110>
2025-12-02 10:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_7.jpg HTTP/1.1" 201 0
2025-12-02 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ee2352e-7751-4296-ae84-88622e09ef25_10.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_10.jpg saved to cache
2025-12-02 10:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c31f3c30-4a52-5772-a6f7-e4cfaf567d8b
2025-12-02 10:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6e3c90>
2025-12-02 10:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_1.jpg HTTP/1.1" 201 0
2025-12-02 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F76248662-9f1a-42ff-835e-94c8f39bcc11_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_7.jpg saved to cache
2025-12-02 10:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff3e908d-aa6d-52b2-97e3-da51e8cd4c48
2025-12-02 10:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8e825d0>
2025-12-02 10:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_0.jpg HTTP/1.1" 201 0
2025-12-02 10:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F76248662-9f1a-42ff-835e-94c8f39bcc11_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_7.jpg saved to cache
2025-12-02 10:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff3e908d-aa6d-52b2-97e3-da51e8cd4c48
2025-12-02 10:03:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff3e908d-aa6d-52b2-97e3-da51e8cd4c48, skipping ID generation
2025-12-02 10:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ff3e908d-aa6d-52b2-97e3-da51e8cd4c48 from tracking dictionaries
2025-12-02 10:03:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff3e908d-aa6d-52b2-97e3-da51e8cd4c48 sending to next pipeline
2025-12-02 10:03:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: ff3e908d-aa6d-52b2-97e3-da51e8cd4c48, identifier: 2837848
2025-12-02 10:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfb2390>
2025-12-02 10:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_0.jpg HTTP/1.1" 201 0
2025-12-02 10:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_7.jpg saved to cache
2025-12-02 10:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f
2025-12-02 10:03:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f, skipping ID generation
2025-12-02 10:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f from tracking dictionaries
2025-12-02 10:03:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f sending to next pipeline
2025-12-02 10:03:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f, identifier: 1783769
2025-12-02 10:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002876443-01986327-003.pdf> (referer: None)
2025-12-02 10:03:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: ff3e908d-aa6d-52b2-97e3-da51e8cd4c48 with identifier: 2837848
2025-12-02 10:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 10:03:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=NERA+BLACK HTTP/1.1" 200 None
2025-12-02 10:03:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 10:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 10:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 10:03:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol+PHEV HTTP/1.1" 200 None
2025-12-02 10:03:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 10:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: ff3e908d-aa6d-52b2-97e3-da51e8cd4c48 with identifier: 2837848
2025-12-02 10:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 177643 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
177643
2025-12-02 10:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ff3e908d-aa6d-52b2-97e3-da51e8cd4c48 spider: manheim.gb
2025-12-02 10:03:31 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: ff3e908d-aa6d-52b2-97e3-da51e8cd4c48 due to rule: high_mileage_for_country.json, error: 177643 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
177643
{'auction_title': '',
'c_o_2_emission_value': 31,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_expert_report_file_1a50cab1-c6ba-4285-9724-95efa142e62f.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002837848-01987678-001.pdf',
'color': 'NERA BLACK',
'currency': 'GBP',
'engine': '1.6L',
'expiration_date': '2025-12-03T09:00:00Z',
'fuel_type': 'Petrol PHEV',
'id': 'ff3e908d-aa6d-52b2-97e3-da51e8cd4c48',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'MH21UUJ',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=2837848',
'listing': 'auction',
'location': 'Leeds - In Transit',
'make': 'PEUGEOT',
'model': '3008',
'odometer': 110383,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 35,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212904,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212904,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220770,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199957,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 200127,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 206537,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196636,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 215436,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 233837,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285068,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 226382,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252871,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288843,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/76248662-9f1a-42ff-835e-94c8f39bcc11_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 473711,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2837848-3991676-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287884,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2837848-3991676-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 278337,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2837848-3991676-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281310,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2837848-3991676-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 256432,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2837848-3991676-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 134451,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2837848-3991676-1004.jpg',
'Width': 749},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff3e908d-aa6d-52b2-97e3-da51e8cd4c48/ff3e908d-aa6d-52b2-97e3-da51e8cd4c48_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375578,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2837848-3991676-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-13',
'seller_name': 'Peugeot',
'title': 'PEUGEOT 3008 1.6 Hybrid 225 Allure Premium 5dr e-EAT8',
'transmission': 'automatic',
'trim': '1.6 Hybrid 225 Allure Premium 5dr e-EAT8',
'year': 2021}
2025-12-02 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272837848%27 HTTP/1.1" 200 None
2025-12-02 10:03:31 [manheim.gb] INFO: Saving data for 2837848: {'created_time': 1764669811.534802, 'last_price_update_time': 1764669811.534817, 'auction_closing_time': 1764752400.0}
2025-12-02 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2837848') HTTP/1.1" 204 0
2025-12-02 10:03:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f with identifier: 1783769
2025-12-02 10:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f with identifier: 1783769
2025-12-02 10:03:31 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f with identifier: 1783769 to the API
2025-12-02 10:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 10:03:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 10:03:31 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_expert_report_file_fe2f6a77-9638-488e-8e38-f1cc43ebf767.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001783769-01975507-003.pdf',
'color': 'BLACK',
'currency': 'GBP',
'engine': '1.2L',
'expiration_date': '2025-12-09T09:00:00Z',
'fuel_type': 'Petrol',
'id': '82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NV67AXY',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=1783769',
'listing': 'auction',
'location': 'Colchester',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 70962,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 35,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 209206,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 209206,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277184,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198720,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196903,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210011,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197374,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196538,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 203651,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 256221,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 255415,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 226042,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 205248,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/14b3134b-c28b-413b-bd6c-bf903dec36b2_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312522,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1783769-3990966-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 418691,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1783769-3990966-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307188,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1783769-3990966-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307844,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1783769-3990966-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324679,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1783769-3990966-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310555,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1783769-3990966-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f/82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334819,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1783769-3990966-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-14',
'seller_name': 'Santander Consumer',
'title': 'NISSAN JUKE 1.2 DiG-T Tekna 5dr',
'transmission': 'manual',
'trim': '1.2 DiG-T Tekna 5dr',
'year': 2017}
2025-12-02 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271783769%27 HTTP/1.1" 200 None
2025-12-02 10:03:31 [manheim.gb] INFO: Saving data for 1783769: {'created_time': 1764669811.932753, 'last_price_update_time': 1764669811.932764, 'auction_closing_time': 1765270800.0}
2025-12-02 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1783769') HTTP/1.1" 204 0
2025-12-02 10:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002143943-01982616-002.pdf)
2025-12-02 10:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002143943-01982616-002.pdf)
2025-12-02 10:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002143943-01982616-002.pdf)
2025-12-02 10:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/308?id=2303707&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232303707&indx=115> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002143943-01982616-002.pdf)
2025-12-02 10:03:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dec22941-a43e-53fc-b2b3-8d383b3adbb2 with identifier: 2817812
2025-12-02 10:03:32 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item dec22941-a43e-53fc-b2b3-8d383b3adbb2
2025-12-02 10:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6e2810>
2025-12-02 10:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_5.jpg HTTP/1.1" 201 0
2025-12-02 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ee2352e-7751-4296-ae84-88622e09ef25_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_4.jpg saved to cache
2025-12-02 10:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c31f3c30-4a52-5772-a6f7-e4cfaf567d8b
2025-12-02 10:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8e53ed0>
2025-12-02 10:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 10:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_4.jpg HTTP/1.1" 201 0
2025-12-02 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ee2352e-7751-4296-ae84-88622e09ef25_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_5.jpg saved to cache
2025-12-02 10:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c31f3c30-4a52-5772-a6f7-e4cfaf567d8b
2025-12-02 10:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bff0290>
2025-12-02 10:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_6.jpg HTTP/1.1" 201 0
2025-12-02 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ee2352e-7751-4296-ae84-88622e09ef25_11.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_11.jpg saved to cache
2025-12-02 10:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c31f3c30-4a52-5772-a6f7-e4cfaf567d8b
2025-12-02 10:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bff2990>
2025-12-02 10:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_expert_report_file_2515fc04-8b47-4dec-8d3d-98fe5ccfd799.pdf HTTP/1.1" 201 0
2025-12-02 10:03:33 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 117adf7a-b7b1-53c5-b58b-649b58f53f7a
2025-12-02 10:03:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 117adf7a-b7b1-53c5-b58b-649b58f53f7a, skipping ID generation
2025-12-02 10:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 117adf7a-b7b1-53c5-b58b-649b58f53f7a
2025-12-02 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2876443-9999999-335123433-004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-004.jpg not downloaded yet
2025-12-02 10:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2698793-4003656-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002698793-01985331-001.pdf)
2025-12-02 10:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2698793-4003656-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002698793-01985331-001.pdf)
2025-12-02 10:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2698793-4003656-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002698793-01985331-001.pdf)
2025-12-02 10:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2698793-4003656-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002698793-01985331-001.pdf)
2025-12-02 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2876443-9999999-335123433-008.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-008.jpg not downloaded yet
2025-12-02 10:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf70490>
2025-12-02 10:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_3.jpg HTTP/1.1" 201 0
2025-12-02 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ee2352e-7751-4296-ae84-88622e09ef25_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_1.jpg saved to cache
2025-12-02 10:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c31f3c30-4a52-5772-a6f7-e4cfaf567d8b
2025-12-02 10:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfb39d0>
2025-12-02 10:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 10:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_1.jpg HTTP/1.1" 201 0
2025-12-02 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ee2352e-7751-4296-ae84-88622e09ef25_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_7.jpg saved to cache
2025-12-02 10:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c31f3c30-4a52-5772-a6f7-e4cfaf567d8b
2025-12-02 10:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6ec150>
2025-12-02 10:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_0.jpg HTTP/1.1" 201 0
2025-12-02 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ee2352e-7751-4296-ae84-88622e09ef25_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_7.jpg saved to cache
2025-12-02 10:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c31f3c30-4a52-5772-a6f7-e4cfaf567d8b
2025-12-02 10:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 723d9a17-88bb-5d93-a02b-ca08decae999 with identifier: 2303707
2025-12-02 10:03:34 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 723d9a17-88bb-5d93-a02b-ca08decae999
2025-12-02 10:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfb2f50>
2025-12-02 10:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_2.jpg HTTP/1.1" 201 0
2025-12-02 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8ee2352e-7751-4296-ae84-88622e09ef25_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_6.jpg saved to cache
2025-12-02 10:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c31f3c30-4a52-5772-a6f7-e4cfaf567d8b
2025-12-02 10:03:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c31f3c30-4a52-5772-a6f7-e4cfaf567d8b, skipping ID generation
2025-12-02 10:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c31f3c30-4a52-5772-a6f7-e4cfaf567d8b from tracking dictionaries
2025-12-02 10:03:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c31f3c30-4a52-5772-a6f7-e4cfaf567d8b sending to next pipeline
2025-12-02 10:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: c31f3c30-4a52-5772-a6f7-e4cfaf567d8b, identifier: 2143943
2025-12-02 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2876443-9999999-335123433-001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-001.jpg not downloaded yet
2025-12-02 10:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: c31f3c30-4a52-5772-a6f7-e4cfaf567d8b with identifier: 2143943
2025-12-02 10:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: c31f3c30-4a52-5772-a6f7-e4cfaf567d8b with identifier: 2143943
2025-12-02 10:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 165757 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
165757
2025-12-02 10:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c31f3c30-4a52-5772-a6f7-e4cfaf567d8b spider: manheim.gb
2025-12-02 10:03:34 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: c31f3c30-4a52-5772-a6f7-e4cfaf567d8b due to rule: high_mileage_for_country.json, error: 165757 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
165757
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_expert_report_file_8787023e-631d-409a-8655-0e4ee979a7b1.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002143943-01982616-002.pdf',
'color': 'Grey',
'currency': 'GBP',
'engine': '2.2L',
'expiration_date': '2025-12-04T09:00:00Z',
'fuel_type': 'Diesel',
'id': 'c31f3c30-4a52-5772-a6f7-e4cfaf567d8b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BX61WDE',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/JAGUAR/XF?id=2143943',
'listing': 'auction',
'location': 'Colchester',
'make': 'JAGUAR',
'model': 'XF',
'odometer': 102997,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 40,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 149805,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 149805,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257231,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 160041,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 146314,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 147015,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 145255,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 137495,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 147837,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 255362,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 229773,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 244755,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299492,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8ee2352e-7751-4296-ae84-88622e09ef25_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348455,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2143943-4002446-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294927,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2143943-4002446-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335478,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2143943-4002446-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327331,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2143943-4002446-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287009,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2143943-4002446-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339759,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2143943-4002446-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c31f3c30-4a52-5772-a6f7-e4cfaf567d8b/c31f3c30-4a52-5772-a6f7-e4cfaf567d8b_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 251278,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2143943-4002446-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-20',
'seller_name': 'Thurlow Nunn',
'title': 'JAGUAR XF 2.2d Portfolio 4dr Auto',
'transmission': 'automatic',
'trim': '2.2d Portfolio 4dr Auto',
'year': 2012}
2025-12-02 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272143943%27 HTTP/1.1" 200 None
2025-12-02 10:03:34 [manheim.gb] INFO: Saving data for 2143943: {'created_time': 1764669814.706472, 'last_price_update_time': 1764669814.706488, 'auction_closing_time': 1764838800.0}
2025-12-02 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2143943') HTTP/1.1" 204 0
2025-12-02 10:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/KUGA?id=2702180&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232702180&indx=167> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2698793-4003656-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002698793-01985331-001.pdf)
2025-12-02 10:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2698793-4003656-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002698793-01985331-001.pdf)
2025-12-02 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2876443-9999999-335123433-002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-002.jpg not downloaded yet
2025-12-02 10:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf70790>
2025-12-02 10:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_18.jpg HTTP/1.1" 201 0
2025-12-02 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2698793-4003656-1004.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2698793-4003656-1004.jpg saved to cache
2025-12-02 10:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 8180215a-eabd-59d5-afd5-daac71f37d0c
2025-12-02 10:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90f3c10>
2025-12-02 10:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_16.jpg HTTP/1.1" 201 0
2025-12-02 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2698793-4003656-1002.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2698793-4003656-1002.jpg saved to cache
2025-12-02 10:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 8180215a-eabd-59d5-afd5-daac71f37d0c
2025-12-02 10:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca890df10>
2025-12-02 10:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_19.jpg HTTP/1.1" 201 0
2025-12-02 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2698793-4003656-1005.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2698793-4003656-1005.jpg saved to cache
2025-12-02 10:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 8180215a-eabd-59d5-afd5-daac71f37d0c
2025-12-02 10:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6f01d0>
2025-12-02 10:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_17.jpg HTTP/1.1" 201 0
2025-12-02 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2698793-4003656-1003.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2698793-4003656-1003.jpg saved to cache
2025-12-02 10:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 8180215a-eabd-59d5-afd5-daac71f37d0c
2025-12-02 10:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002698793-01985331-001.pdf)
2025-12-02 10:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002698793-01985331-001.pdf)
2025-12-02 10:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002698793-01985331-001.pdf)
2025-12-02 10:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002698793-01985331-001.pdf)
2025-12-02 10:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002698793-01985331-001.pdf)
2025-12-02 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2876443-9999999-335123433-003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-003.jpg not downloaded yet
2025-12-02 10:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2698793-4003656-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002698793-01985331-001.pdf)
2025-12-02 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2876443-9999999-335123433-005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-005.jpg not downloaded yet
2025-12-02 10:03:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59095e7f-870d-5a50-a160-8de614dc5b4a with identifier: 2702180
2025-12-02 10:03:35 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 59095e7f-870d-5a50-a160-8de614dc5b4a
2025-12-02 10:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfdfd90>
2025-12-02 10:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_14.jpg HTTP/1.1" 201 0
2025-12-02 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2698793-4003656-1000.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2698793-4003656-1000.jpg saved to cache
2025-12-02 10:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8180215a-eabd-59d5-afd5-daac71f37d0c
2025-12-02 10:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ed1750>
2025-12-02 10:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_15.jpg HTTP/1.1" 201 0
2025-12-02 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2698793-4003656-1001.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2698793-4003656-1001.jpg saved to cache
2025-12-02 10:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 8180215a-eabd-59d5-afd5-daac71f37d0c
2025-12-02 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2876443-9999999-335123433-006.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-006.jpg not downloaded yet
2025-12-02 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2876443-9999999-335123433-007.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-007.jpg not downloaded yet
2025-12-02 10:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfc9550>
2025-12-02 10:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_10.jpg HTTP/1.1" 201 0
2025-12-02 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60c0a941-4931-4d75-a343-0d8f739c36f4_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_5.jpg saved to cache
2025-12-02 10:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8180215a-eabd-59d5-afd5-daac71f37d0c
2025-12-02 10:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ea0a10>
2025-12-02 10:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_7.jpg HTTP/1.1" 201 0
2025-12-02 10:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60c0a941-4931-4d75-a343-0d8f739c36f4_10.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_10.jpg saved to cache
2025-12-02 10:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8180215a-eabd-59d5-afd5-daac71f37d0c
2025-12-02 10:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8f96510>
2025-12-02 10:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_8.jpg HTTP/1.1" 201 0
2025-12-02 10:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60c0a941-4931-4d75-a343-0d8f739c36f4_9.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_9.jpg saved to cache
2025-12-02 10:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8180215a-eabd-59d5-afd5-daac71f37d0c
2025-12-02 10:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8e73e50>
2025-12-02 10:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_11.jpg HTTP/1.1" 201 0
2025-12-02 10:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60c0a941-4931-4d75-a343-0d8f739c36f4_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_3.jpg saved to cache
2025-12-02 10:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8180215a-eabd-59d5-afd5-daac71f37d0c
2025-12-02 10:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca88e5650>
2025-12-02 10:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_9.jpg HTTP/1.1" 201 0
2025-12-02 10:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60c0a941-4931-4d75-a343-0d8f739c36f4_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_2.jpg saved to cache
2025-12-02 10:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8180215a-eabd-59d5-afd5-daac71f37d0c
2025-12-02 10:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90b9110>
2025-12-02 10:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_13.jpg HTTP/1.1" 201 0
2025-12-02 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2698793-4003656-13.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2698793-4003656-13.jpg saved to cache
2025-12-02 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8180215a-eabd-59d5-afd5-daac71f37d0c
2025-12-02 10:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002698793-01985331-001.pdf)
2025-12-02 10:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002698793-01985331-001.pdf)
2025-12-02 10:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-008.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002876443-01986327-003.pdf)
2025-12-02 10:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002876443-01986327-003.pdf)
2025-12-02 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2876443-9999999-335123433-009.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-009.jpg not downloaded yet
2025-12-02 10:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002876443-01986327-003.pdf)
2025-12-02 10:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002876443-01986327-003.pdf)
2025-12-02 10:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2660446-4003506-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002660446-01985389-003.pdf)
2025-12-02 10:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FIAT/500?id=2752960&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232752960&indx=173> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002321815-01987253-002.pdf)
2025-12-02 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2876443-9999999-335123433-010.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-010.jpg not downloaded yet
2025-12-02 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2876443-9999999-335123433-011.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-011.jpg not downloaded yet
2025-12-02 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2876443-9999999-335123433-012.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-012.jpg not downloaded yet
2025-12-02 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2876443-4003409-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-13.jpg not downloaded yet
2025-12-02 10:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bffafd0>
2025-12-02 10:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_4.jpg HTTP/1.1" 201 0
2025-12-02 10:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60c0a941-4931-4d75-a343-0d8f739c36f4_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_5.jpg saved to cache
2025-12-02 10:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8180215a-eabd-59d5-afd5-daac71f37d0c
2025-12-02 10:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca9007b50>
2025-12-02 10:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_3.jpg HTTP/1.1" 201 0
2025-12-02 10:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60c0a941-4931-4d75-a343-0d8f739c36f4_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_1.jpg saved to cache
2025-12-02 10:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8180215a-eabd-59d5-afd5-daac71f37d0c
2025-12-02 10:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8fa2ed0>
2025-12-02 10:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_1.jpg HTTP/1.1" 201 0
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2876443-9999999-335123433-008.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-008.jpg saved to cache
2025-12-02 10:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 117adf7a-b7b1-53c5-b58b-649b58f53f7a
2025-12-02 10:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8e49a90>
2025-12-02 10:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_2.jpg HTTP/1.1" 201 0
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2876443-9999999-335123433-001.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-001.jpg saved to cache
2025-12-02 10:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 117adf7a-b7b1-53c5-b58b-649b58f53f7a
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2876443-4003409-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-1000.jpg not downloaded yet
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2876443-4003409-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-1001.jpg not downloaded yet
2025-12-02 10:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/RANGEROVEREVOQUE?id=2316345&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232316345&indx=117> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfbf6d0>
2025-12-02 10:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_0.jpg HTTP/1.1" 201 0
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2876443-9999999-335123433-004.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-004.jpg saved to cache
2025-12-02 10:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 117adf7a-b7b1-53c5-b58b-649b58f53f7a
2025-12-02 10:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b0af750>
2025-12-02 10:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_3.jpg HTTP/1.1" 201 0
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2876443-9999999-335123433-002.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-002.jpg saved to cache
2025-12-02 10:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 117adf7a-b7b1-53c5-b58b-649b58f53f7a
2025-12-02 10:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b609450>
2025-12-02 10:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_17.jpg HTTP/1.1" 201 0
2025-12-02 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2660446-4003506-1003.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2660446-4003506-1003.jpg saved to cache
2025-12-02 10:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 1f7dfe2a-7581-5021-af0a-ac80d728d074
2025-12-02 10:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ccbb4f0-c655-535c-9a07-373fe75f454a with identifier: 2752960
2025-12-02 10:03:41 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9ccbb4f0-c655-535c-9a07-373fe75f454a
2025-12-02 10:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca89004d0>
2025-12-02 10:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_17.jpg HTTP/1.1" 201 0
2025-12-02 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2321815-4003575-1004.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1004.jpg saved to cache
2025-12-02 10:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1
2025-12-02 10:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002321815-01987253-002.pdf)
2025-12-02 10:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002321815-01987253-002.pdf)
2025-12-02 10:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002698793-01985331-001.pdf)
2025-12-02 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2876443-4003409-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-1002.jpg not downloaded yet
2025-12-02 10:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002876443-01986327-003.pdf)
2025-12-02 10:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2660446-4003506-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002660446-01985389-003.pdf)
2025-12-02 10:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002876443-01986327-003.pdf)
2025-12-02 10:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002876443-01986327-003.pdf)
2025-12-02 10:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-007.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002876443-01986327-003.pdf)
2025-12-02 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2876443-4003409-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-1003.jpg not downloaded yet
2025-12-02 10:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5eaa6529-614d-5baa-a891-8bdb8d7ebb77 with identifier: 2316345
2025-12-02 10:03:41 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5eaa6529-614d-5baa-a891-8bdb8d7ebb77
2025-12-02 10:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002817812-01982445-005.pdf> (referer: None)
2025-12-02 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2876443-4003409-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-1004.jpg not downloaded yet
2025-12-02 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2876443-4003409-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-1005.jpg not downloaded yet
2025-12-02 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2876443-4003409-1006.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-1006.jpg not downloaded yet
2025-12-02 10:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca901d590>
2025-12-02 10:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 10:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_15.jpg HTTP/1.1" 201 0
2025-12-02 10:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2321815-4003575-1002.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1002.jpg saved to cache
2025-12-02 10:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1
2025-12-02 10:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca9033890>
2025-12-02 10:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_16.jpg HTTP/1.1" 201 0
2025-12-02 10:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2321815-4003575-1003.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1003.jpg saved to cache
2025-12-02 10:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1
2025-12-02 10:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bff9590>
2025-12-02 10:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_2.jpg HTTP/1.1" 201 0
2025-12-02 10:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60c0a941-4931-4d75-a343-0d8f739c36f4_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_6.jpg saved to cache
2025-12-02 10:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8180215a-eabd-59d5-afd5-daac71f37d0c
2025-12-02 10:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002876443-01986327-003.pdf)
2025-12-02 10:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-009.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002876443-01986327-003.pdf)
2025-12-02 10:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-011.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002876443-01986327-003.pdf)
2025-12-02 10:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-010.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002876443-01986327-003.pdf)
2025-12-02 10:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfdf7d0>
2025-12-02 10:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_4.jpg HTTP/1.1" 201 0
2025-12-02 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2876443-9999999-335123433-003.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-003.jpg saved to cache
2025-12-02 10:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 117adf7a-b7b1-53c5-b58b-649b58f53f7a
2025-12-02 10:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b0a9850>
2025-12-02 10:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 10:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_16.jpg HTTP/1.1" 201 0
2025-12-02 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2660446-4003506-1002.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2660446-4003506-1002.jpg saved to cache
2025-12-02 10:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 1f7dfe2a-7581-5021-af0a-ac80d728d074
2025-12-02 10:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8fc5010>
2025-12-02 10:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_5.jpg HTTP/1.1" 201 0
2025-12-02 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2876443-9999999-335123433-005.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-005.jpg saved to cache
2025-12-02 10:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 117adf7a-b7b1-53c5-b58b-649b58f53f7a
2025-12-02 10:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfdf6d0>
2025-12-02 10:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_6.jpg HTTP/1.1" 201 0
2025-12-02 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2876443-9999999-335123433-006.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-006.jpg saved to cache
2025-12-02 10:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 117adf7a-b7b1-53c5-b58b-649b58f53f7a
2025-12-02 10:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfc85d0>
2025-12-02 10:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_7.jpg HTTP/1.1" 201 0
2025-12-02 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2876443-9999999-335123433-007.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-007.jpg saved to cache
2025-12-02 10:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 117adf7a-b7b1-53c5-b58b-649b58f53f7a
2025-12-02 10:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfc9290>
2025-12-02 10:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_expert_report_file_19b89bea-06e0-4bf1-b67e-b1dd2be18ac6.pdf HTTP/1.1" 201 0
2025-12-02 10:03:45 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item dec22941-a43e-53fc-b2b3-8d383b3adbb2
2025-12-02 10:03:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dec22941-a43e-53fc-b2b3-8d383b3adbb2, skipping ID generation
2025-12-02 10:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item dec22941-a43e-53fc-b2b3-8d383b3adbb2
2025-12-02 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F94305c10-12b9-4001-8f68-dd0a128e1102_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_7.jpg not downloaded yet
2025-12-02 10:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-012.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002876443-01986327-003.pdf)
2025-12-02 10:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2660446-4003506-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002660446-01985389-003.pdf)
2025-12-02 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F94305c10-12b9-4001-8f68-dd0a128e1102_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_7.jpg not downloaded yet
2025-12-02 10:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002876443-01986327-003.pdf)
2025-12-02 10:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6d0890>
2025-12-02 10:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_14.jpg HTTP/1.1" 201 0
2025-12-02 10:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2876443-4003409-1001.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-1001.jpg saved to cache
2025-12-02 10:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 117adf7a-b7b1-53c5-b58b-649b58f53f7a
2025-12-02 10:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ed18d0>
2025-12-02 10:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_8.jpg HTTP/1.1" 201 0
2025-12-02 10:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2876443-9999999-335123433-009.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-009.jpg saved to cache
2025-12-02 10:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 117adf7a-b7b1-53c5-b58b-649b58f53f7a
2025-12-02 10:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b641a50>
2025-12-02 10:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_10.jpg HTTP/1.1" 201 0
2025-12-02 10:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2876443-9999999-335123433-011.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-011.jpg saved to cache
2025-12-02 10:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 117adf7a-b7b1-53c5-b58b-649b58f53f7a
2025-12-02 10:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90ebd10>
2025-12-02 10:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_9.jpg HTTP/1.1" 201 0
2025-12-02 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2876443-9999999-335123433-010.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-010.jpg saved to cache
2025-12-02 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 117adf7a-b7b1-53c5-b58b-649b58f53f7a
2025-12-02 10:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002876443-01986327-003.pdf)
2025-12-02 10:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002698793-01985331-001.pdf)
2025-12-02 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F94305c10-12b9-4001-8f68-dd0a128e1102_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_6.jpg not downloaded yet
2025-12-02 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F94305c10-12b9-4001-8f68-dd0a128e1102_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_1.jpg not downloaded yet
2025-12-02 10:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002876443-01986327-003.pdf)
2025-12-02 10:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-1006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002876443-01986327-003.pdf)
2025-12-02 10:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002876443-01986327-003.pdf)
2025-12-02 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F94305c10-12b9-4001-8f68-dd0a128e1102_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_5.jpg not downloaded yet
2025-12-02 10:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8eef690>
2025-12-02 10:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_11.jpg HTTP/1.1" 201 0
2025-12-02 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2876443-9999999-335123433-012.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-012.jpg saved to cache
2025-12-02 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 117adf7a-b7b1-53c5-b58b-649b58f53f7a
2025-12-02 10:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8fd0a10>
2025-12-02 10:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_15.jpg HTTP/1.1" 201 0
2025-12-02 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2660446-4003506-1001.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2660446-4003506-1001.jpg saved to cache
2025-12-02 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 1f7dfe2a-7581-5021-af0a-ac80d728d074
2025-12-02 10:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8f2a190>
2025-12-02 10:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_12.jpg HTTP/1.1" 201 0
2025-12-02 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2876443-4003409-13.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-13.jpg saved to cache
2025-12-02 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 117adf7a-b7b1-53c5-b58b-649b58f53f7a
2025-12-02 10:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002702180-01985627-003.pdf> (referer: None)
2025-12-02 10:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002876443-01986327-003.pdf)
2025-12-02 10:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002876443-01986327-003.pdf)
2025-12-02 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F94305c10-12b9-4001-8f68-dd0a128e1102_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_4.jpg not downloaded yet
2025-12-02 10:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002303707-01985105-002.pdf> (referer: None)
2025-12-02 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F94305c10-12b9-4001-8f68-dd0a128e1102_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_11.jpg not downloaded yet
2025-12-02 10:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002817812-01982445-005.pdf)
2025-12-02 10:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002817812-01982445-005.pdf)
2025-12-02 10:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf65590>
2025-12-02 10:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 10:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_13.jpg HTTP/1.1" 201 0
2025-12-02 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2876443-4003409-1000.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-1000.jpg saved to cache
2025-12-02 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 117adf7a-b7b1-53c5-b58b-649b58f53f7a
2025-12-02 10:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b0af350>
2025-12-02 10:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_1.jpg HTTP/1.1" 201 0
2025-12-02 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60c0a941-4931-4d75-a343-0d8f739c36f4_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_7.jpg saved to cache
2025-12-02 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8180215a-eabd-59d5-afd5-daac71f37d0c
2025-12-02 10:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8902190>
2025-12-02 10:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_15.jpg HTTP/1.1" 201 0
2025-12-02 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2876443-4003409-1002.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-1002.jpg saved to cache
2025-12-02 10:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 117adf7a-b7b1-53c5-b58b-649b58f53f7a
2025-12-02 10:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8fa1cd0>
2025-12-02 10:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 10:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_19.jpg HTTP/1.1" 201 0
2025-12-02 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2876443-4003409-1006.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-1006.jpg saved to cache
2025-12-02 10:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 117adf7a-b7b1-53c5-b58b-649b58f53f7a
2025-12-02 10:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf17990>
2025-12-02 10:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_18.jpg HTTP/1.1" 201 0
2025-12-02 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2876443-4003409-1005.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-1005.jpg saved to cache
2025-12-02 10:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 117adf7a-b7b1-53c5-b58b-649b58f53f7a
2025-12-02 10:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2660446-4003506-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002660446-01985389-003.pdf)
2025-12-02 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F94305c10-12b9-4001-8f68-dd0a128e1102_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_10.jpg not downloaded yet
2025-12-02 10:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002321815-01987253-002.pdf)
2025-12-02 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F94305c10-12b9-4001-8f68-dd0a128e1102_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_9.jpg not downloaded yet
2025-12-02 10:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MINI/HATCHBACK?id=2830703&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232830703&indx=187> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002698793-01985331-001.pdf)
2025-12-02 10:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002321815-01987253-002.pdf)
2025-12-02 10:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002817812-01982445-005.pdf)
2025-12-02 10:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002817812-01982445-005.pdf)
2025-12-02 10:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F94305c10-12b9-4001-8f68-dd0a128e1102_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_2.jpg not downloaded yet
2025-12-02 10:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8e488d0>
2025-12-02 10:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_expert_report_file_0df0923d-0630-4049-afc0-3fa5c42e301f.pdf HTTP/1.1" 201 0
2025-12-02 10:03:50 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 59095e7f-870d-5a50-a160-8de614dc5b4a
2025-12-02 10:03:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 59095e7f-870d-5a50-a160-8de614dc5b4a, skipping ID generation
2025-12-02 10:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 59095e7f-870d-5a50-a160-8de614dc5b4a
2025-12-02 10:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_7.jpg not downloaded yet
2025-12-02 10:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfbcc90>
2025-12-02 10:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_16.jpg HTTP/1.1" 201 0
2025-12-02 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2876443-4003409-1003.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-1003.jpg saved to cache
2025-12-02 10:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 117adf7a-b7b1-53c5-b58b-649b58f53f7a
2025-12-02 10:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ebe850>
2025-12-02 10:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_17.jpg HTTP/1.1" 201 0
2025-12-02 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2876443-4003409-1004.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-1004.jpg saved to cache
2025-12-02 10:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 117adf7a-b7b1-53c5-b58b-649b58f53f7a
2025-12-02 10:03:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 117adf7a-b7b1-53c5-b58b-649b58f53f7a, skipping ID generation
2025-12-02 10:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 117adf7a-b7b1-53c5-b58b-649b58f53f7a from tracking dictionaries
2025-12-02 10:03:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 117adf7a-b7b1-53c5-b58b-649b58f53f7a sending to next pipeline
2025-12-02 10:03:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 117adf7a-b7b1-53c5-b58b-649b58f53f7a, identifier: 2876443
2025-12-02 10:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8f0a9d0>
2025-12-02 10:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_expert_report_file_7c8e6a2c-1674-4008-a6c6-267699a5dafb.pdf HTTP/1.1" 201 0
2025-12-02 10:03:52 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 723d9a17-88bb-5d93-a02b-ca08decae999
2025-12-02 10:03:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 723d9a17-88bb-5d93-a02b-ca08decae999, skipping ID generation
2025-12-02 10:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 723d9a17-88bb-5d93-a02b-ca08decae999
2025-12-02 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_7.jpg not downloaded yet
2025-12-02 10:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf70a50>
2025-12-02 10:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_0.jpg HTTP/1.1" 201 0
2025-12-02 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F94305c10-12b9-4001-8f68-dd0a128e1102_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_7.jpg saved to cache
2025-12-02 10:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dec22941-a43e-53fc-b2b3-8d383b3adbb2
2025-12-02 10:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8e509d0>
2025-12-02 10:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_1.jpg HTTP/1.1" 201 0
2025-12-02 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F94305c10-12b9-4001-8f68-dd0a128e1102_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_7.jpg saved to cache
2025-12-02 10:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dec22941-a43e-53fc-b2b3-8d383b3adbb2
2025-12-02 10:03:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 117adf7a-b7b1-53c5-b58b-649b58f53f7a with identifier: 2876443
2025-12-02 10:03:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 117adf7a-b7b1-53c5-b58b-649b58f53f7a with identifier: 2876443
2025-12-02 10:03:53 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 117adf7a-b7b1-53c5-b58b-649b58f53f7a with identifier: 2876443 to the API
2025-12-02 10:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 10:03:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 10:03:53 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-1004.jpg>
{'auction_title': '',
'c_o_2_emission_value': 101,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_expert_report_file_2515fc04-8b47-4dec-8d3d-98fe5ccfd799.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002876443-01986327-003.pdf',
'color': 'BLACK',
'currency': 'GBP',
'engine': '1.0L',
'expiration_date': '2025-12-03T09:00:00Z',
'fuel_type': 'Petrol',
'id': '117adf7a-b7b1-53c5-b58b-649b58f53f7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NL18EUU',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/POLO?id=2876443',
'listing': 'auction',
'location': 'Washington',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 73778,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317414,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242334,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-008.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 227367,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 270447,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314953,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263300,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-005.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291399,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-006.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329927,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-007.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253038,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-009.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197214,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-010.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 215998,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-011.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301855,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2876443-9999999-335123433-012.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400062,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 482557,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180336,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 185422,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307997,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359866,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 229209,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-1005.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117adf7a-b7b1-53c5-b58b-649b58f53f7a/117adf7a-b7b1-53c5-b58b-649b58f53f7a_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257979,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2876443-4003409-1006.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-28',
'seller_name': 'Lookers',
'title': 'VOLKSWAGEN POLO 1.0 TSI 95 SE 5dr',
'transmission': 'manual',
'trim': '1.0 TSI 95 SE 5dr',
'year': 2018}
2025-12-02 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272876443%27 HTTP/1.1" 200 None
2025-12-02 10:03:53 [manheim.gb] INFO: Saving data for 2876443: {'created_time': 1764669833.669211, 'last_price_update_time': 1764669833.669223, 'auction_closing_time': 1764752400.0}
2025-12-02 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2876443') HTTP/1.1" 204 0
2025-12-02 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F94305c10-12b9-4001-8f68-dd0a128e1102_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_5.jpg not downloaded yet
2025-12-02 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_7.jpg not downloaded yet
2025-12-02 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_7.jpg not downloaded yet
2025-12-02 10:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLVO/V40?id=2303945&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232303945&indx=116> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F94305c10-12b9-4001-8f68-dd0a128e1102_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_3.jpg not downloaded yet
2025-12-02 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_6.jpg not downloaded yet
2025-12-02 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_6.jpg not downloaded yet
2025-12-02 10:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b608e10>
2025-12-02 10:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_14.jpg HTTP/1.1" 201 0
2025-12-02 10:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2660446-4003506-1000.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2660446-4003506-1000.jpg saved to cache
2025-12-02 10:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 1f7dfe2a-7581-5021-af0a-ac80d728d074
2025-12-02 10:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8f4d5d0>
2025-12-02 10:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_14.jpg HTTP/1.1" 201 0
2025-12-02 10:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2321815-4003575-1001.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1001.jpg saved to cache
2025-12-02 10:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1
2025-12-02 10:03:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79f1a13d-7203-5b0f-8b79-f7b133941800 with identifier: 2830703
2025-12-02 10:03:54 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 79f1a13d-7203-5b0f-8b79-f7b133941800
2025-12-02 10:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b635e50>
2025-12-02 10:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_0.jpg HTTP/1.1" 201 0
2025-12-02 10:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60c0a941-4931-4d75-a343-0d8f739c36f4_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_7.jpg saved to cache
2025-12-02 10:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8180215a-eabd-59d5-afd5-daac71f37d0c
2025-12-02 10:03:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8180215a-eabd-59d5-afd5-daac71f37d0c, skipping ID generation
2025-12-02 10:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8180215a-eabd-59d5-afd5-daac71f37d0c from tracking dictionaries
2025-12-02 10:03:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8180215a-eabd-59d5-afd5-daac71f37d0c sending to next pipeline
2025-12-02 10:03:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 8180215a-eabd-59d5-afd5-daac71f37d0c, identifier: 2698793
2025-12-02 10:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8912f50>
2025-12-02 10:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_13.jpg HTTP/1.1" 201 0
2025-12-02 10:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2321815-4003575-1000.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1000.jpg saved to cache
2025-12-02 10:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1
2025-12-02 10:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b60acd0>
2025-12-02 10:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_3.jpg HTTP/1.1" 201 0
2025-12-02 10:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F94305c10-12b9-4001-8f68-dd0a128e1102_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_1.jpg saved to cache
2025-12-02 10:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dec22941-a43e-53fc-b2b3-8d383b3adbb2
2025-12-02 10:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b62bd50>
2025-12-02 10:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_2.jpg HTTP/1.1" 201 0
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F94305c10-12b9-4001-8f68-dd0a128e1102_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_6.jpg saved to cache
2025-12-02 10:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dec22941-a43e-53fc-b2b3-8d383b3adbb2
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F94305c10-12b9-4001-8f68-dd0a128e1102_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_4.jpg not downloaded yet
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_1.jpg not downloaded yet
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_1.jpg not downloaded yet
2025-12-02 10:03:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 8180215a-eabd-59d5-afd5-daac71f37d0c with identifier: 2698793
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLUE HTTP/1.1" 200 None
2025-12-02 10:03:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 10:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 8180215a-eabd-59d5-afd5-daac71f37d0c with identifier: 2698793
2025-12-02 10:03:56 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 8180215a-eabd-59d5-afd5-daac71f37d0c with identifier: 2698793 to the API
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 10:03:56 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 103,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_expert_report_file_5f59878f-08f1-4d80-8941-8379429da6d5.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002698793-01985331-001.pdf',
'color': 'BLUE',
'currency': 'GBP',
'engine': '1.6L',
'expiration_date': '2025-12-03T09:00:00Z',
'fuel_type': 'Diesel',
'id': '8180215a-eabd-59d5-afd5-daac71f37d0c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DN66KFZ',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/ASTRA?id=2698793',
'listing': 'auction',
'location': 'Washington',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 89914,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 170147,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 170147,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210975,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172695,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 162207,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 165630,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 169950,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 167466,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 170404,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 236078,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195914,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237802,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 207103,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/60c0a941-4931-4d75-a343-0d8f739c36f4_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389086,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2698793-4003656-13.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305017,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2698793-4003656-1000.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 270336,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2698793-4003656-1001.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245302,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2698793-4003656-1002.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303955,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2698793-4003656-1003.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204951,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2698793-4003656-1004.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180215a-eabd-59d5-afd5-daac71f37d0c/8180215a-eabd-59d5-afd5-daac71f37d0c_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389449,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2698793-4003656-1005.jpg',
'Width': 1500}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-28',
'seller_name': 'Lookers',
'title': 'VAUXHALL ASTRA 1.6 CDTi 16V 136 SRi Nav 5dr',
'transmission': 'manual',
'trim': '1.6 CDTi 16V 136 SRi Nav 5dr',
'year': 2016}
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272698793%27 HTTP/1.1" 200 None
2025-12-02 10:03:56 [manheim.gb] INFO: Saving data for 2698793: {'created_time': 1764669836.706626, 'last_price_update_time': 1764669836.706639, 'auction_closing_time': 1764752400.0}
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2698793') HTTP/1.1" 204 0
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2817812-4003117-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2817812-4003117-13.jpg not downloaded yet
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe2b2949b-be39-4e2f-bf7e-6b3d74911b0c_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_5.jpg not downloaded yet
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffbb5acf5-e45b-45f0-8203-f27be2c5fdc0_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_5.jpg not downloaded yet
2025-12-02 10:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 972ab119-db10-56e3-9ac0-82a1791b387f with identifier: 2303945
2025-12-02 10:03:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 972ab119-db10-56e3-9ac0-82a1791b387f
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2817812-4003117-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2817812-4003117-1000.jpg not downloaded yet
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe2b2949b-be39-4e2f-bf7e-6b3d74911b0c_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_4.jpg not downloaded yet
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffbb5acf5-e45b-45f0-8203-f27be2c5fdc0_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_4.jpg not downloaded yet
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2817812-4003117-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2817812-4003117-1001.jpg not downloaded yet
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe2b2949b-be39-4e2f-bf7e-6b3d74911b0c_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_11.jpg not downloaded yet
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffbb5acf5-e45b-45f0-8203-f27be2c5fdc0_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_11.jpg not downloaded yet
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2817812-4003117-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2817812-4003117-1002.jpg not downloaded yet
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe2b2949b-be39-4e2f-bf7e-6b3d74911b0c_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_10.jpg not downloaded yet
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffbb5acf5-e45b-45f0-8203-f27be2c5fdc0_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_10.jpg not downloaded yet
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2817812-4003117-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2817812-4003117-1003.jpg not downloaded yet
2025-12-02 10:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe2b2949b-be39-4e2f-bf7e-6b3d74911b0c_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_9.jpg not downloaded yet
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffbb5acf5-e45b-45f0-8203-f27be2c5fdc0_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_9.jpg not downloaded yet
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2817812-4003117-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2817812-4003117-1004.jpg not downloaded yet
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_2.jpg not downloaded yet
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_2.jpg not downloaded yet
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2817812-4003117-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2817812-4003117-1005.jpg not downloaded yet
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_5.jpg not downloaded yet
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_5.jpg not downloaded yet
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_3.jpg not downloaded yet
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_3.jpg not downloaded yet
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_4.jpg not downloaded yet
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_4.jpg not downloaded yet
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2702180-4003348-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-13.jpg not downloaded yet
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2303707-4004366-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2303707-4004366-13.jpg not downloaded yet
2025-12-02 10:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002752960-01987310-002.pdf> (referer: None)
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2702180-4003348-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1000.jpg not downloaded yet
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2303707-4004366-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2303707-4004366-1000.jpg not downloaded yet
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2702180-4003348-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1001.jpg not downloaded yet
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2303707-4004366-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2303707-4004366-1001.jpg not downloaded yet
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2702180-4003348-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1002.jpg not downloaded yet
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2303707-4004366-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2303707-4004366-1002.jpg not downloaded yet
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2702180-4003348-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1003.jpg not downloaded yet
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2303707-4004366-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2303707-4004366-1003.jpg not downloaded yet
2025-12-02 10:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b609c50>
2025-12-02 10:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_expert_report_file_dd422f68-6974-46c0-b143-4d2c302f8f96.pdf HTTP/1.1" 201 0
2025-12-02 10:03:57 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9ccbb4f0-c655-535c-9a07-373fe75f454a
2025-12-02 10:03:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9ccbb4f0-c655-535c-9a07-373fe75f454a, skipping ID generation
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 9ccbb4f0-c655-535c-9a07-373fe75f454a
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_7.jpg not downloaded yet
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2702180-4003348-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1004.jpg not downloaded yet
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2303707-4004366-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2303707-4004366-1004.jpg not downloaded yet
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_7.jpg not downloaded yet
2025-12-02 10:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002702180-01985627-003.pdf)
2025-12-02 10:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002702180-01985627-003.pdf)
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2702180-4003348-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1005.jpg not downloaded yet
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2303707-4004366-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2303707-4004366-1005.jpg not downloaded yet
2025-12-02 10:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303707-01985105-002.pdf)
2025-12-02 10:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2817812-4003117-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002817812-01982445-005.pdf)
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_6.jpg not downloaded yet
2025-12-02 10:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2817812-4003117-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002817812-01982445-005.pdf)
2025-12-02 10:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303707-01985105-002.pdf)
2025-12-02 10:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002702180-01985627-003.pdf)
2025-12-02 10:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303707-01985105-002.pdf)
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_1.jpg not downloaded yet
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F54f72a4d-c85e-49f2-9bab-8624b5b4985b_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_5.jpg not downloaded yet
2025-12-02 10:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8dae2d0>
2025-12-02 10:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 10:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_11.jpg HTTP/1.1" 201 0
2025-12-02 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_3.jpg saved to cache
2025-12-02 10:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 59095e7f-870d-5a50-a160-8de614dc5b4a
2025-12-02 10:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8d7d510>
2025-12-02 10:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_10.jpg HTTP/1.1" 201 0
2025-12-02 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_5.jpg saved to cache
2025-12-02 10:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 59095e7f-870d-5a50-a160-8de614dc5b4a
2025-12-02 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F54f72a4d-c85e-49f2-9bab-8624b5b4985b_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_4.jpg not downloaded yet
2025-12-02 10:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303707-01985105-002.pdf)
2025-12-02 10:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303707-01985105-002.pdf)
2025-12-02 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F54f72a4d-c85e-49f2-9bab-8624b5b4985b_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_11.jpg not downloaded yet
2025-12-02 10:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002702180-01985627-003.pdf)
2025-12-02 10:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2817812-4003117-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002817812-01982445-005.pdf)
2025-12-02 10:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2817812-4003117-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002817812-01982445-005.pdf)
2025-12-02 10:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002702180-01985627-003.pdf)
2025-12-02 10:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bff3d10>
2025-12-02 10:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_11.jpg HTTP/1.1" 201 0
2025-12-02 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_3.jpg saved to cache
2025-12-02 10:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 723d9a17-88bb-5d93-a02b-ca08decae999
2025-12-02 10:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8edc850>
2025-12-02 10:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_19.jpg HTTP/1.1" 201 0
2025-12-02 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2817812-4003117-1005.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2817812-4003117-1005.jpg saved to cache
2025-12-02 10:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item dec22941-a43e-53fc-b2b3-8d383b3adbb2
2025-12-02 10:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ded910>
2025-12-02 10:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_18.jpg HTTP/1.1" 201 0
2025-12-02 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2817812-4003117-1004.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2817812-4003117-1004.jpg saved to cache
2025-12-02 10:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item dec22941-a43e-53fc-b2b3-8d383b3adbb2
2025-12-02 10:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ede050>
2025-12-02 10:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_10.jpg HTTP/1.1" 201 0
2025-12-02 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_5.jpg saved to cache
2025-12-02 10:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 723d9a17-88bb-5d93-a02b-ca08decae999
2025-12-02 10:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b0ae6d0>
2025-12-02 10:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_9.jpg HTTP/1.1" 201 0
2025-12-02 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_2.jpg saved to cache
2025-12-02 10:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 59095e7f-870d-5a50-a160-8de614dc5b4a
2025-12-02 10:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf89410>
2025-12-02 10:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_9.jpg HTTP/1.1" 201 0
2025-12-02 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_2.jpg saved to cache
2025-12-02 10:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 723d9a17-88bb-5d93-a02b-ca08decae999
2025-12-02 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F54f72a4d-c85e-49f2-9bab-8624b5b4985b_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_10.jpg not downloaded yet
2025-12-02 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F54f72a4d-c85e-49f2-9bab-8624b5b4985b_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_9.jpg not downloaded yet
2025-12-02 10:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002752960-01987310-002.pdf)
2025-12-02 10:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002752960-01987310-002.pdf)
2025-12-02 10:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002752960-01987310-002.pdf)
2025-12-02 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_2.jpg not downloaded yet
2025-12-02 10:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ea6ad0>
2025-12-02 10:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 10:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_8.jpg HTTP/1.1" 201 0
2025-12-02 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffbb5acf5-e45b-45f0-8203-f27be2c5fdc0_9.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_9.jpg saved to cache
2025-12-02 10:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 723d9a17-88bb-5d93-a02b-ca08decae999
2025-12-02 10:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf72010>
2025-12-02 10:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_7.jpg HTTP/1.1" 201 0
2025-12-02 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffbb5acf5-e45b-45f0-8203-f27be2c5fdc0_10.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_10.jpg saved to cache
2025-12-02 10:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 723d9a17-88bb-5d93-a02b-ca08decae999
2025-12-02 10:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ded810>
2025-12-02 10:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_8.jpg HTTP/1.1" 201 0
2025-12-02 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe2b2949b-be39-4e2f-bf7e-6b3d74911b0c_9.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_9.jpg saved to cache
2025-12-02 10:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 59095e7f-870d-5a50-a160-8de614dc5b4a
2025-12-02 10:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8fc6390>
2025-12-02 10:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_17.jpg HTTP/1.1" 201 0
2025-12-02 10:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2817812-4003117-1003.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2817812-4003117-1003.jpg saved to cache
2025-12-02 10:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item dec22941-a43e-53fc-b2b3-8d383b3adbb2
2025-12-02 10:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf704d0>
2025-12-02 10:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_16.jpg HTTP/1.1" 201 0
2025-12-02 10:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2817812-4003117-1002.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2817812-4003117-1002.jpg saved to cache
2025-12-02 10:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item dec22941-a43e-53fc-b2b3-8d383b3adbb2
2025-12-02 10:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca88d2a90>
2025-12-02 10:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_7.jpg HTTP/1.1" 201 0
2025-12-02 10:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe2b2949b-be39-4e2f-bf7e-6b3d74911b0c_10.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_10.jpg saved to cache
2025-12-02 10:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 59095e7f-870d-5a50-a160-8de614dc5b4a
2025-12-02 10:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2303707-4004366-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303707-01985105-002.pdf)
2025-12-02 10:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_5.jpg not downloaded yet
2025-12-02 10:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_3.jpg not downloaded yet
2025-12-02 10:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002752960-01987310-002.pdf)
2025-12-02 10:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002702180-01985627-003.pdf)
2025-12-02 10:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002752960-01987310-002.pdf)
2025-12-02 10:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002752960-01987310-002.pdf)
2025-12-02 10:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8903890>
2025-12-02 10:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_3.jpg HTTP/1.1" 201 0
2025-12-02 10:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_1.jpg saved to cache
2025-12-02 10:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9ccbb4f0-c655-535c-9a07-373fe75f454a
2025-12-02 10:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8d449d0>
2025-12-02 10:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_4.jpg HTTP/1.1" 201 0
2025-12-02 10:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F54f72a4d-c85e-49f2-9bab-8624b5b4985b_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_5.jpg saved to cache
2025-12-02 10:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9ccbb4f0-c655-535c-9a07-373fe75f454a
2025-12-02 10:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90b2190>
2025-12-02 10:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_2.jpg HTTP/1.1" 201 0
2025-12-02 10:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_6.jpg saved to cache
2025-12-02 10:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9ccbb4f0-c655-535c-9a07-373fe75f454a
2025-12-02 10:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2303707-4004366-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303707-01985105-002.pdf)
2025-12-02 10:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002702180-01985627-003.pdf)
2025-12-02 10:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_4.jpg not downloaded yet
2025-12-02 10:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2752960-4004046-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2752960-4004046-13.jpg not downloaded yet
2025-12-02 10:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002752960-01987310-002.pdf)
2025-12-02 10:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002752960-01987310-002.pdf)
2025-12-02 10:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2752960-4004046-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2752960-4004046-1000.jpg not downloaded yet
2025-12-02 10:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8edf910>
2025-12-02 10:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_19.jpg HTTP/1.1" 201 0
2025-12-02 10:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2303707-4004366-1005.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2303707-4004366-1005.jpg saved to cache
2025-12-02 10:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 723d9a17-88bb-5d93-a02b-ca08decae999
2025-12-02 10:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8fe5810>
2025-12-02 10:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_1.jpg HTTP/1.1" 201 0
2025-12-02 10:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_7.jpg saved to cache
2025-12-02 10:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9ccbb4f0-c655-535c-9a07-373fe75f454a
2025-12-02 10:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6bf250>
2025-12-02 10:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_19.jpg HTTP/1.1" 201 0
2025-12-02 10:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2702180-4003348-1005.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1005.jpg saved to cache
2025-12-02 10:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 59095e7f-870d-5a50-a160-8de614dc5b4a
2025-12-02 10:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf7b750>
2025-12-02 10:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_7.jpg HTTP/1.1" 201 0
2025-12-02 10:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F54f72a4d-c85e-49f2-9bab-8624b5b4985b_10.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_10.jpg saved to cache
2025-12-02 10:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9ccbb4f0-c655-535c-9a07-373fe75f454a
2025-12-02 10:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8edf490>
2025-12-02 10:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_0.jpg HTTP/1.1" 201 0
2025-12-02 10:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_7.jpg saved to cache
2025-12-02 10:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9ccbb4f0-c655-535c-9a07-373fe75f454a
2025-12-02 10:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2752960-4004046-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2752960-4004046-1001.jpg not downloaded yet
2025-12-02 10:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002702180-01985627-003.pdf)
2025-12-02 10:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002752960-01987310-002.pdf)
2025-12-02 10:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2752960-4004046-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2752960-4004046-1002.jpg not downloaded yet
2025-12-02 10:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002752960-01987310-002.pdf)
2025-12-02 10:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2303707-4004366-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303707-01985105-002.pdf)
2025-12-02 10:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002702180-01985627-003.pdf)
2025-12-02 10:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf24c90>
2025-12-02 10:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_18.jpg HTTP/1.1" 201 0
2025-12-02 10:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2303707-4004366-1004.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2303707-4004366-1004.jpg saved to cache
2025-12-02 10:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 723d9a17-88bb-5d93-a02b-ca08decae999
2025-12-02 10:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ff8510>
2025-12-02 10:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_18.jpg HTTP/1.1" 201 0
2025-12-02 10:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2702180-4003348-1004.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1004.jpg saved to cache
2025-12-02 10:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 59095e7f-870d-5a50-a160-8de614dc5b4a
2025-12-02 10:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8dd7a90>
2025-12-02 10:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_5.jpg HTTP/1.1" 201 0
2025-12-02 10:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F54f72a4d-c85e-49f2-9bab-8624b5b4985b_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_4.jpg saved to cache
2025-12-02 10:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9ccbb4f0-c655-535c-9a07-373fe75f454a
2025-12-02 10:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca911de90>
2025-12-02 10:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_6.jpg HTTP/1.1" 201 0
2025-12-02 10:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F54f72a4d-c85e-49f2-9bab-8624b5b4985b_11.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_11.jpg saved to cache
2025-12-02 10:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9ccbb4f0-c655-535c-9a07-373fe75f454a
2025-12-02 10:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2303707-4004366-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303707-01985105-002.pdf)
2025-12-02 10:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2303707-4004366-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303707-01985105-002.pdf)
2025-12-02 10:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2752960-4004046-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2752960-4004046-1003.jpg not downloaded yet
2025-12-02 10:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002316345-01989419-002.pdf> (referer: None)
2025-12-02 10:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2752960-4004046-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2752960-4004046-1004.jpg not downloaded yet
2025-12-02 10:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002752960-01987310-002.pdf)
2025-12-02 10:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2752960-4004046-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2752960-4004046-1005.jpg not downloaded yet
2025-12-02 10:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8e71490>
2025-12-02 10:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_17.jpg HTTP/1.1" 201 0
2025-12-02 10:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2702180-4003348-1003.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1003.jpg saved to cache
2025-12-02 10:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 59095e7f-870d-5a50-a160-8de614dc5b4a
2025-12-02 10:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfded50>
2025-12-02 10:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_9.jpg HTTP/1.1" 201 0
2025-12-02 10:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_2.jpg saved to cache
2025-12-02 10:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9ccbb4f0-c655-535c-9a07-373fe75f454a
2025-12-02 10:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca88d4e90>
2025-12-02 10:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_8.jpg HTTP/1.1" 201 0
2025-12-02 10:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F54f72a4d-c85e-49f2-9bab-8624b5b4985b_9.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_9.jpg saved to cache
2025-12-02 10:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9ccbb4f0-c655-535c-9a07-373fe75f454a
2025-12-02 10:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfdf890>
2025-12-02 10:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_15.jpg HTTP/1.1" 201 0
2025-12-02 10:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2303707-4004366-1001.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2303707-4004366-1001.jpg saved to cache
2025-12-02 10:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 723d9a17-88bb-5d93-a02b-ca08decae999
2025-12-02 10:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ed1a10>
2025-12-02 10:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_16.jpg HTTP/1.1" 201 0
2025-12-02 10:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2702180-4003348-1002.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1002.jpg saved to cache
2025-12-02 10:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 59095e7f-870d-5a50-a160-8de614dc5b4a
2025-12-02 10:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2752960-4004046-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002752960-01987310-002.pdf)
2025-12-02 10:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2752960-4004046-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002752960-01987310-002.pdf)
2025-12-02 10:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002752960-01987310-002.pdf)
2025-12-02 10:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002752960-01987310-002.pdf)
2025-12-02 10:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002702180-01985627-003.pdf)
2025-12-02 10:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ec5690>
2025-12-02 10:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_17.jpg HTTP/1.1" 201 0
2025-12-02 10:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2303707-4004366-1003.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2303707-4004366-1003.jpg saved to cache
2025-12-02 10:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 723d9a17-88bb-5d93-a02b-ca08decae999
2025-12-02 10:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b0a81d0>
2025-12-02 10:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_16.jpg HTTP/1.1" 201 0
2025-12-02 10:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2303707-4004366-1002.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2303707-4004366-1002.jpg saved to cache
2025-12-02 10:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 723d9a17-88bb-5d93-a02b-ca08decae999
2025-12-02 10:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8f22490>
2025-12-02 10:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_expert_report_file_09c1a146-aa4d-4e3f-941d-2d04c4e22afc.pdf HTTP/1.1" 201 0
2025-12-02 10:04:09 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5eaa6529-614d-5baa-a891-8bdb8d7ebb77
2025-12-02 10:04:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5eaa6529-614d-5baa-a891-8bdb8d7ebb77, skipping ID generation
2025-12-02 10:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 5eaa6529-614d-5baa-a891-8bdb8d7ebb77
2025-12-02 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_7.jpg not downloaded yet
2025-12-02 10:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6d3e10>
2025-12-02 10:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 10:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_12.jpg HTTP/1.1" 201 0
2025-12-02 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_4.jpg saved to cache
2025-12-02 10:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9ccbb4f0-c655-535c-9a07-373fe75f454a
2025-12-02 10:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002702180-01985627-003.pdf)
2025-12-02 10:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2303707-4004366-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303707-01985105-002.pdf)
2025-12-02 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_7.jpg not downloaded yet
2025-12-02 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_6.jpg not downloaded yet
2025-12-02 10:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8d5aad0>
2025-12-02 10:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_14.jpg HTTP/1.1" 201 0
2025-12-02 10:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2752960-4004046-1000.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2752960-4004046-1000.jpg saved to cache
2025-12-02 10:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 9ccbb4f0-c655-535c-9a07-373fe75f454a
2025-12-02 10:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf72490>
2025-12-02 10:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_13.jpg HTTP/1.1" 201 0
2025-12-02 10:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2752960-4004046-13.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2752960-4004046-13.jpg saved to cache
2025-12-02 10:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9ccbb4f0-c655-535c-9a07-373fe75f454a
2025-12-02 10:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8f60ad0>
2025-12-02 10:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_11.jpg HTTP/1.1" 201 0
2025-12-02 10:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_3.jpg saved to cache
2025-12-02 10:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9ccbb4f0-c655-535c-9a07-373fe75f454a
2025-12-02 10:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf6dc90>
2025-12-02 10:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_10.jpg HTTP/1.1" 201 0
2025-12-02 10:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_5.jpg saved to cache
2025-12-02 10:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9ccbb4f0-c655-535c-9a07-373fe75f454a
2025-12-02 10:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8f6a390>
2025-12-02 10:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_14.jpg HTTP/1.1" 201 0
2025-12-02 10:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2702180-4003348-1000.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1000.jpg saved to cache
2025-12-02 10:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 59095e7f-870d-5a50-a160-8de614dc5b4a
2025-12-02 10:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_1.jpg not downloaded yet
2025-12-02 10:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90d7550>
2025-12-02 10:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_15.jpg HTTP/1.1" 201 0
2025-12-02 10:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2702180-4003348-1001.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1001.jpg saved to cache
2025-12-02 10:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 59095e7f-870d-5a50-a160-8de614dc5b4a
2025-12-02 10:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca89290d0>
2025-12-02 10:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_14.jpg HTTP/1.1" 201 0
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2303707-4004366-1000.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2303707-4004366-1000.jpg saved to cache
2025-12-02 10:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 723d9a17-88bb-5d93-a02b-ca08decae999
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff21b7838-8abb-43e1-aa29-2a96c611c5bd_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_5.jpg not downloaded yet
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff21b7838-8abb-43e1-aa29-2a96c611c5bd_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_4.jpg not downloaded yet
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff21b7838-8abb-43e1-aa29-2a96c611c5bd_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_11.jpg not downloaded yet
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff21b7838-8abb-43e1-aa29-2a96c611c5bd_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_10.jpg not downloaded yet
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff21b7838-8abb-43e1-aa29-2a96c611c5bd_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_9.jpg not downloaded yet
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_2.jpg not downloaded yet
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_5.jpg not downloaded yet
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_3.jpg not downloaded yet
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_4.jpg not downloaded yet
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2316345-4003621-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2316345-4003621-13.jpg not downloaded yet
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2316345-4003621-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2316345-4003621-1000.jpg not downloaded yet
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2316345-4003621-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2316345-4003621-1001.jpg not downloaded yet
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2316345-4003621-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2316345-4003621-1002.jpg not downloaded yet
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2316345-4003621-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2316345-4003621-1003.jpg not downloaded yet
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2316345-4003621-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2316345-4003621-1004.jpg not downloaded yet
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2316345-4003621-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2316345-4003621-1005.jpg not downloaded yet
2025-12-02 10:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2316345-4003621-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002316345-01989419-002.pdf)
2025-12-02 10:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002316345-01989419-002.pdf)
2025-12-02 10:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2316345-4003621-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002316345-01989419-002.pdf)
2025-12-02 10:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2316345-4003621-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002316345-01989419-002.pdf)
2025-12-02 10:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2316345-4003621-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002316345-01989419-002.pdf)
2025-12-02 10:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8fc7b90>
2025-12-02 10:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 10:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_16.jpg HTTP/1.1" 201 0
2025-12-02 10:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2316345-4003621-1002.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2316345-4003621-1002.jpg saved to cache
2025-12-02 10:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 5eaa6529-614d-5baa-a891-8bdb8d7ebb77
2025-12-02 10:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2316345-4003621-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002316345-01989419-002.pdf)
2025-12-02 10:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002316345-01989419-002.pdf)
2025-12-02 10:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002316345-01989419-002.pdf)
2025-12-02 10:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2316345-4003621-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002316345-01989419-002.pdf)
2025-12-02 10:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002316345-01989419-002.pdf)
2025-12-02 10:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002316345-01989419-002.pdf)
2025-12-02 10:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002316345-01989419-002.pdf)
2025-12-02 10:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6d3a10>
2025-12-02 10:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_12.jpg HTTP/1.1" 201 0
2025-12-02 10:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_4.jpg saved to cache
2025-12-02 10:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 5eaa6529-614d-5baa-a891-8bdb8d7ebb77
2025-12-02 10:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90c3790>
2025-12-02 10:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_15.jpg HTTP/1.1" 201 0
2025-12-02 10:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2316345-4003621-1001.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2316345-4003621-1001.jpg saved to cache
2025-12-02 10:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 5eaa6529-614d-5baa-a891-8bdb8d7ebb77
2025-12-02 10:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90c2990>
2025-12-02 10:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_19.jpg HTTP/1.1" 201 0
2025-12-02 10:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2316345-4003621-1005.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2316345-4003621-1005.jpg saved to cache
2025-12-02 10:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 5eaa6529-614d-5baa-a891-8bdb8d7ebb77
2025-12-02 10:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b634710>
2025-12-02 10:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_18.jpg HTTP/1.1" 201 0
2025-12-02 10:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2316345-4003621-1004.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2316345-4003621-1004.jpg saved to cache
2025-12-02 10:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 5eaa6529-614d-5baa-a891-8bdb8d7ebb77
2025-12-02 10:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2316345-4003621-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002316345-01989419-002.pdf)
2025-12-02 10:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002316345-01989419-002.pdf)
2025-12-02 10:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002316345-01989419-002.pdf)
2025-12-02 10:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002316345-01989419-002.pdf)
2025-12-02 10:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8d72ed0>
2025-12-02 10:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_17.jpg HTTP/1.1" 201 0
2025-12-02 10:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2316345-4003621-1003.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2316345-4003621-1003.jpg saved to cache
2025-12-02 10:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 5eaa6529-614d-5baa-a891-8bdb8d7ebb77
2025-12-02 10:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf83490>
2025-12-02 10:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_7.jpg HTTP/1.1" 201 0
2025-12-02 10:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff21b7838-8abb-43e1-aa29-2a96c611c5bd_10.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_10.jpg saved to cache
2025-12-02 10:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5eaa6529-614d-5baa-a891-8bdb8d7ebb77
2025-12-02 10:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfb2510>
2025-12-02 10:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_8.jpg HTTP/1.1" 201 0
2025-12-02 10:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff21b7838-8abb-43e1-aa29-2a96c611c5bd_9.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_9.jpg saved to cache
2025-12-02 10:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5eaa6529-614d-5baa-a891-8bdb8d7ebb77
2025-12-02 10:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8f78d50>
2025-12-02 10:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_14.jpg HTTP/1.1" 201 0
2025-12-02 10:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2316345-4003621-1000.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2316345-4003621-1000.jpg saved to cache
2025-12-02 10:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 5eaa6529-614d-5baa-a891-8bdb8d7ebb77
2025-12-02 10:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4caa933890>
2025-12-02 10:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_11.jpg HTTP/1.1" 201 0
2025-12-02 10:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_3.jpg saved to cache
2025-12-02 10:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 5eaa6529-614d-5baa-a891-8bdb8d7ebb77
2025-12-02 10:04:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf7eed0>
2025-12-02 10:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_10.jpg HTTP/1.1" 201 0
2025-12-02 10:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_5.jpg saved to cache
2025-12-02 10:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 5eaa6529-614d-5baa-a891-8bdb8d7ebb77
2025-12-02 10:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8fc4850>
2025-12-02 10:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_9.jpg HTTP/1.1" 201 0
2025-12-02 10:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_2.jpg saved to cache
2025-12-02 10:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5eaa6529-614d-5baa-a891-8bdb8d7ebb77
2025-12-02 10:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002316345-01989419-002.pdf)
2025-12-02 10:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002316345-01989419-002.pdf)
2025-12-02 10:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002316345-01989419-002.pdf)
2025-12-02 10:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002316345-01989419-002.pdf)
2025-12-02 10:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90aaad0>
2025-12-02 10:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_13.jpg HTTP/1.1" 201 0
2025-12-02 10:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2316345-4003621-13.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2316345-4003621-13.jpg saved to cache
2025-12-02 10:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 5eaa6529-614d-5baa-a891-8bdb8d7ebb77
2025-12-02 10:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca88d6c50>
2025-12-02 10:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_6.jpg HTTP/1.1" 201 0
2025-12-02 10:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff21b7838-8abb-43e1-aa29-2a96c611c5bd_11.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_11.jpg saved to cache
2025-12-02 10:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5eaa6529-614d-5baa-a891-8bdb8d7ebb77
2025-12-02 10:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6ed250>
2025-12-02 10:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_4.jpg HTTP/1.1" 201 0
2025-12-02 10:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff21b7838-8abb-43e1-aa29-2a96c611c5bd_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_5.jpg saved to cache
2025-12-02 10:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5eaa6529-614d-5baa-a891-8bdb8d7ebb77
2025-12-02 10:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90ab090>
2025-12-02 10:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_5.jpg HTTP/1.1" 201 0
2025-12-02 10:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff21b7838-8abb-43e1-aa29-2a96c611c5bd_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_4.jpg saved to cache
2025-12-02 10:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5eaa6529-614d-5baa-a891-8bdb8d7ebb77
2025-12-02 10:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2752960-4004046-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002752960-01987310-002.pdf)
2025-12-02 10:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2752960-4004046-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002752960-01987310-002.pdf)
2025-12-02 10:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2752960-4004046-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002752960-01987310-002.pdf)
2025-12-02 10:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2752960-4004046-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002752960-01987310-002.pdf)
2025-12-02 10:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2752960-4004046-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002752960-01987310-002.pdf)
2025-12-02 10:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2303707-4004366-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303707-01985105-002.pdf)
2025-12-02 10:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8dac790>
2025-12-02 10:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_3.jpg HTTP/1.1" 201 0
2025-12-02 10:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_1.jpg saved to cache
2025-12-02 10:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5eaa6529-614d-5baa-a891-8bdb8d7ebb77
2025-12-02 10:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8dac810>
2025-12-02 10:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_1.jpg HTTP/1.1" 201 0
2025-12-02 10:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_7.jpg saved to cache
2025-12-02 10:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5eaa6529-614d-5baa-a891-8bdb8d7ebb77
2025-12-02 10:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca88d6f90>
2025-12-02 10:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_0.jpg HTTP/1.1" 201 0
2025-12-02 10:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_7.jpg saved to cache
2025-12-02 10:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5eaa6529-614d-5baa-a891-8bdb8d7ebb77
2025-12-02 10:04:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8eed950>
2025-12-02 10:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_2.jpg HTTP/1.1" 201 0
2025-12-02 10:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_6.jpg saved to cache
2025-12-02 10:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5eaa6529-614d-5baa-a891-8bdb8d7ebb77
2025-12-02 10:04:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5eaa6529-614d-5baa-a891-8bdb8d7ebb77, skipping ID generation
2025-12-02 10:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5eaa6529-614d-5baa-a891-8bdb8d7ebb77 from tracking dictionaries
2025-12-02 10:04:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5eaa6529-614d-5baa-a891-8bdb8d7ebb77 sending to next pipeline
2025-12-02 10:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 5eaa6529-614d-5baa-a891-8bdb8d7ebb77, identifier: 2316345
2025-12-02 10:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002702180-01985627-003.pdf)
2025-12-02 10:04:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 5eaa6529-614d-5baa-a891-8bdb8d7ebb77 with identifier: 2316345
2025-12-02 10:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 5eaa6529-614d-5baa-a891-8bdb8d7ebb77 with identifier: 2316345
2025-12-02 10:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 157189 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
157189
2025-12-02 10:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 5eaa6529-614d-5baa-a891-8bdb8d7ebb77 spider: manheim.gb
2025-12-02 10:04:19 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 5eaa6529-614d-5baa-a891-8bdb8d7ebb77 due to rule: high_mileage_for_country.json, error: 157189 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
157189
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_expert_report_file_09c1a146-aa4d-4e3f-941d-2d04c4e22afc.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002316345-01989419-002.pdf',
'color': 'BLACK',
'currency': 'GBP',
'engine': '2.0L',
'expiration_date': '2025-12-09T09:00:00Z',
'fuel_type': 'Diesel',
'id': '5eaa6529-614d-5baa-a891-8bdb8d7ebb77',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BN17ZCT',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/RANGE%20ROVER%20EVOQUE?id=2316345',
'listing': 'auction',
'location': 'Manchester',
'make': 'LAND ROVER',
'model': 'RANGE ROVER EVOQUE',
'odometer': 97673,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 49,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 178705,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 178705,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 244584,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 161676,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 191671,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187453,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187978,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181525,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179844,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 249805,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 200594,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216978,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 230216,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f21b7838-8abb-43e1-aa29-2a96c611c5bd_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381759,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2316345-4003621-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239464,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2316345-4003621-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310172,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2316345-4003621-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 229258,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2316345-4003621-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257519,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2316345-4003621-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 156974,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2316345-4003621-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eaa6529-614d-5baa-a891-8bdb8d7ebb77/5eaa6529-614d-5baa-a891-8bdb8d7ebb77_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 349129,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2316345-4003621-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-22',
'seller_name': 'MotoNovo Finance',
'title': 'LAND ROVER RANGE ROVER EVOQUE 2.0 eD4 SE Tech 5dr 2WD',
'transmission': 'manual',
'trim': '2.0 eD4 SE Tech 5dr 2WD',
'year': 2017}
2025-12-02 10:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272316345%27 HTTP/1.1" 200 None
2025-12-02 10:04:19 [manheim.gb] INFO: Saving data for 2316345: {'created_time': 1764669859.912424, 'last_price_update_time': 1764669859.912435, 'auction_closing_time': 1765270800.0}
2025-12-02 10:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2316345') HTTP/1.1" 204 0
2025-12-02 10:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2817812-4003117-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002817812-01982445-005.pdf)
2025-12-02 10:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002702180-01985627-003.pdf)
2025-12-02 10:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303707-01985105-002.pdf)
2025-12-02 10:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303707-01985105-002.pdf)
2025-12-02 10:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002702180-01985627-003.pdf)
2025-12-02 10:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303707-01985105-002.pdf)
2025-12-02 10:04:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4caa5827d0>
2025-12-02 10:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_18.jpg HTTP/1.1" 201 0
2025-12-02 10:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2752960-4004046-1004.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2752960-4004046-1004.jpg saved to cache
2025-12-02 10:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 9ccbb4f0-c655-535c-9a07-373fe75f454a
2025-12-02 10:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90c0c10>
2025-12-02 10:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_17.jpg HTTP/1.1" 201 0
2025-12-02 10:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2752960-4004046-1003.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2752960-4004046-1003.jpg saved to cache
2025-12-02 10:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 9ccbb4f0-c655-535c-9a07-373fe75f454a
2025-12-02 10:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b66d750>
2025-12-02 10:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_16.jpg HTTP/1.1" 201 0
2025-12-02 10:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2752960-4004046-1002.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2752960-4004046-1002.jpg saved to cache
2025-12-02 10:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 9ccbb4f0-c655-535c-9a07-373fe75f454a
2025-12-02 10:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8e4bf50>
2025-12-02 10:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_19.jpg HTTP/1.1" 201 0
2025-12-02 10:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2752960-4004046-1005.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2752960-4004046-1005.jpg saved to cache
2025-12-02 10:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 9ccbb4f0-c655-535c-9a07-373fe75f454a
2025-12-02 10:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90c2f90>
2025-12-02 10:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_15.jpg HTTP/1.1" 201 0
2025-12-02 10:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2752960-4004046-1001.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2752960-4004046-1001.jpg saved to cache
2025-12-02 10:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 9ccbb4f0-c655-535c-9a07-373fe75f454a
2025-12-02 10:04:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9ccbb4f0-c655-535c-9a07-373fe75f454a, skipping ID generation
2025-12-02 10:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9ccbb4f0-c655-535c-9a07-373fe75f454a from tracking dictionaries
2025-12-02 10:04:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9ccbb4f0-c655-535c-9a07-373fe75f454a sending to next pipeline
2025-12-02 10:04:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 9ccbb4f0-c655-535c-9a07-373fe75f454a, identifier: 2752960
2025-12-02 10:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf60950>
2025-12-02 10:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_13.jpg HTTP/1.1" 201 0
2025-12-02 10:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2303707-4004366-13.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2303707-4004366-13.jpg saved to cache
2025-12-02 10:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 723d9a17-88bb-5d93-a02b-ca08decae999
2025-12-02 10:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8f084d0>
2025-12-02 10:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_13.jpg HTTP/1.1" 201 0
2025-12-02 10:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2702180-4003348-13.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-13.jpg saved to cache
2025-12-02 10:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 59095e7f-870d-5a50-a160-8de614dc5b4a
2025-12-02 10:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002702180-01985627-003.pdf)
2025-12-02 10:04:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 9ccbb4f0-c655-535c-9a07-373fe75f454a with identifier: 2752960
2025-12-02 10:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 9ccbb4f0-c655-535c-9a07-373fe75f454a with identifier: 2752960
2025-12-02 10:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 164229 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
164229
2025-12-02 10:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 9ccbb4f0-c655-535c-9a07-373fe75f454a spider: manheim.gb
2025-12-02 10:04:22 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 9ccbb4f0-c655-535c-9a07-373fe75f454a due to rule: high_mileage_for_country.json, error: 164229 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
164229
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_expert_report_file_dd422f68-6974-46c0-b143-4d2c302f8f96.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002752960-01987310-002.pdf',
'color': 'Grey',
'currency': 'GBP',
'engine': '1.2L',
'expiration_date': '2025-12-04T09:00:00Z',
'fuel_type': 'Petrol',
'id': '9ccbb4f0-c655-535c-9a07-373fe75f454a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WN62UPA',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FIAT/500?id=2752960',
'listing': 'auction',
'location': 'Colchester',
'make': 'FIAT',
'model': '500',
'odometer': 102048,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 255788,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 255788,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 229421,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 144038,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180837,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181971,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198099,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 215081,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210716,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 177789,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 142357,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 152444,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 234012,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/54f72a4d-c85e-49f2-9bab-8624b5b4985b_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311028,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2752960-4004046-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304565,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2752960-4004046-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 174553,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2752960-4004046-1001.jpg',
'Width': 749},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 390064,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2752960-4004046-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320879,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2752960-4004046-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315183,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2752960-4004046-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ccbb4f0-c655-535c-9a07-373fe75f454a/9ccbb4f0-c655-535c-9a07-373fe75f454a_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 404917,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2752960-4004046-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-10-11',
'seller_name': 'Harwoods Group',
'title': 'FIAT 500 1.2 Lounge 3dr',
'transmission': 'manual',
'trim': '1.2 Lounge 3dr',
'year': 2012}
2025-12-02 10:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272752960%27 HTTP/1.1" 200 None
2025-12-02 10:04:22 [manheim.gb] INFO: Saving data for 2752960: {'created_time': 1764669862.507197, 'last_price_update_time': 1764669862.507207, 'auction_closing_time': 1764838800.0}
2025-12-02 10:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2752960') HTTP/1.1" 204 0
2025-12-02 10:04:22 [scrapy.extensions.logstats] INFO: Crawled 66 pages (at 14 pages/min), scraped 10 items (at 3 items/min)
2025-12-02 10:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303707-01985105-002.pdf)
2025-12-02 10:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfb79d0>
2025-12-02 10:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 10:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_15.jpg HTTP/1.1" 201 0
2025-12-02 10:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2817812-4003117-1001.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2817812-4003117-1001.jpg saved to cache
2025-12-02 10:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item dec22941-a43e-53fc-b2b3-8d383b3adbb2
2025-12-02 10:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90b2010>
2025-12-02 10:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_12.jpg HTTP/1.1" 201 0
2025-12-02 10:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_4.jpg saved to cache
2025-12-02 10:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 59095e7f-870d-5a50-a160-8de614dc5b4a
2025-12-02 10:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b60a750>
2025-12-02 10:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_6.jpg HTTP/1.1" 201 0
2025-12-02 10:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffbb5acf5-e45b-45f0-8203-f27be2c5fdc0_11.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_11.jpg saved to cache
2025-12-02 10:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 723d9a17-88bb-5d93-a02b-ca08decae999
2025-12-02 10:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8d5b110>
2025-12-02 10:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 10:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_12.jpg HTTP/1.1" 201 0
2025-12-02 10:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_4.jpg saved to cache
2025-12-02 10:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 723d9a17-88bb-5d93-a02b-ca08decae999
2025-12-02 10:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b608410>
2025-12-02 10:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 10:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_6.jpg HTTP/1.1" 201 0
2025-12-02 10:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe2b2949b-be39-4e2f-bf7e-6b3d74911b0c_11.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_11.jpg saved to cache
2025-12-02 10:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 59095e7f-870d-5a50-a160-8de614dc5b4a
2025-12-02 10:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca9200110>
2025-12-02 10:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_5.jpg HTTP/1.1" 201 0
2025-12-02 10:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffbb5acf5-e45b-45f0-8203-f27be2c5fdc0_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_4.jpg saved to cache
2025-12-02 10:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 723d9a17-88bb-5d93-a02b-ca08decae999
2025-12-02 10:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca9136690>
2025-12-02 10:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 10:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_5.jpg HTTP/1.1" 201 0
2025-12-02 10:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe2b2949b-be39-4e2f-bf7e-6b3d74911b0c_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_4.jpg saved to cache
2025-12-02 10:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 59095e7f-870d-5a50-a160-8de614dc5b4a
2025-12-02 10:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2817812-4003117-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002817812-01982445-005.pdf)
2025-12-02 10:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303707-01985105-002.pdf)
2025-12-02 10:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2817812-4003117-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002817812-01982445-005.pdf)
2025-12-02 10:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002702180-01985627-003.pdf)
2025-12-02 10:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002702180-01985627-003.pdf)
2025-12-02 10:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002817812-01982445-005.pdf)
2025-12-02 10:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303707-01985105-002.pdf)
2025-12-02 10:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf88350>
2025-12-02 10:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_4.jpg HTTP/1.1" 201 0
2025-12-02 10:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffbb5acf5-e45b-45f0-8203-f27be2c5fdc0_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_5.jpg saved to cache
2025-12-02 10:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 723d9a17-88bb-5d93-a02b-ca08decae999
2025-12-02 10:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002702180-01985627-003.pdf)
2025-12-02 10:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002817812-01982445-005.pdf)
2025-12-02 10:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303707-01985105-002.pdf)
2025-12-02 10:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8f97450>
2025-12-02 10:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_14.jpg HTTP/1.1" 201 0
2025-12-02 10:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2817812-4003117-1000.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2817812-4003117-1000.jpg saved to cache
2025-12-02 10:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item dec22941-a43e-53fc-b2b3-8d383b3adbb2
2025-12-02 10:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8d58e90>
2025-12-02 10:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 10:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_3.jpg HTTP/1.1" 201 0
2025-12-02 10:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_1.jpg saved to cache
2025-12-02 10:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 723d9a17-88bb-5d93-a02b-ca08decae999
2025-12-02 10:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca9137090>
2025-12-02 10:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_13.jpg HTTP/1.1" 201 0
2025-12-02 10:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2817812-4003117-13.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2817812-4003117-13.jpg saved to cache
2025-12-02 10:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item dec22941-a43e-53fc-b2b3-8d383b3adbb2
2025-12-02 10:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca88d5110>
2025-12-02 10:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_4.jpg HTTP/1.1" 201 0
2025-12-02 10:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe2b2949b-be39-4e2f-bf7e-6b3d74911b0c_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_5.jpg saved to cache
2025-12-02 10:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 59095e7f-870d-5a50-a160-8de614dc5b4a
2025-12-02 10:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bff1d90>
2025-12-02 10:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:25 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxproduction.blob.core.windows.net
2025-12-02 10:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_3.jpg HTTP/1.1" 201 0
2025-12-02 10:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_1.jpg saved to cache
2025-12-02 10:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 59095e7f-870d-5a50-a160-8de614dc5b4a
2025-12-02 10:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ed0390>
2025-12-02 10:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_12.jpg HTTP/1.1" 201 0
2025-12-02 10:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F94305c10-12b9-4001-8f68-dd0a128e1102_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_4.jpg saved to cache
2025-12-02 10:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item dec22941-a43e-53fc-b2b3-8d383b3adbb2
2025-12-02 10:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf71a10>
2025-12-02 10:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_2.jpg HTTP/1.1" 201 0
2025-12-02 10:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_6.jpg saved to cache
2025-12-02 10:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 723d9a17-88bb-5d93-a02b-ca08decae999
2025-12-02 10:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002817812-01982445-005.pdf)
2025-12-02 10:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002702180-01985627-003.pdf)
2025-12-02 10:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303707-01985105-002.pdf)
2025-12-02 10:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002817812-01982445-005.pdf)
2025-12-02 10:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002702180-01985627-003.pdf)
2025-12-02 10:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002817812-01982445-005.pdf)
2025-12-02 10:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf7b810>
2025-12-02 10:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_2.jpg HTTP/1.1" 201 0
2025-12-02 10:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_6.jpg saved to cache
2025-12-02 10:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 59095e7f-870d-5a50-a160-8de614dc5b4a
2025-12-02 10:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8d458d0>
2025-12-02 10:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_11.jpg HTTP/1.1" 201 0
2025-12-02 10:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F94305c10-12b9-4001-8f68-dd0a128e1102_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_3.jpg saved to cache
2025-12-02 10:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item dec22941-a43e-53fc-b2b3-8d383b3adbb2
2025-12-02 10:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ea2b10>
2025-12-02 10:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_1.jpg HTTP/1.1" 201 0
2025-12-02 10:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_7.jpg saved to cache
2025-12-02 10:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 723d9a17-88bb-5d93-a02b-ca08decae999
2025-12-02 10:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002817812-01982445-005.pdf)
2025-12-02 10:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002817812-01982445-005.pdf)
2025-12-02 10:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002817812-01982445-005.pdf)
2025-12-02 10:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002817812-01982445-005.pdf)
2025-12-02 10:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ec6010>
2025-12-02 10:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_10.jpg HTTP/1.1" 201 0
2025-12-02 10:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F94305c10-12b9-4001-8f68-dd0a128e1102_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_5.jpg saved to cache
2025-12-02 10:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item dec22941-a43e-53fc-b2b3-8d383b3adbb2
2025-12-02 10:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca911cf10>
2025-12-02 10:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_1.jpg HTTP/1.1" 201 0
2025-12-02 10:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_7.jpg saved to cache
2025-12-02 10:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 59095e7f-870d-5a50-a160-8de614dc5b4a
2025-12-02 10:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfb7990>
2025-12-02 10:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_0.jpg HTTP/1.1" 201 0
2025-12-02 10:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_7.jpg saved to cache
2025-12-02 10:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 723d9a17-88bb-5d93-a02b-ca08decae999
2025-12-02 10:04:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 723d9a17-88bb-5d93-a02b-ca08decae999, skipping ID generation
2025-12-02 10:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 723d9a17-88bb-5d93-a02b-ca08decae999 from tracking dictionaries
2025-12-02 10:04:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 723d9a17-88bb-5d93-a02b-ca08decae999 sending to next pipeline
2025-12-02 10:04:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 723d9a17-88bb-5d93-a02b-ca08decae999, identifier: 2303707
2025-12-02 10:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4cab45ba90>
2025-12-02 10:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 10:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_8.jpg HTTP/1.1" 201 0
2025-12-02 10:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F94305c10-12b9-4001-8f68-dd0a128e1102_9.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_9.jpg saved to cache
2025-12-02 10:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dec22941-a43e-53fc-b2b3-8d383b3adbb2
2025-12-02 10:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfb2650>
2025-12-02 10:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_0.jpg HTTP/1.1" 201 0
2025-12-02 10:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_7.jpg saved to cache
2025-12-02 10:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 59095e7f-870d-5a50-a160-8de614dc5b4a
2025-12-02 10:04:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 59095e7f-870d-5a50-a160-8de614dc5b4a, skipping ID generation
2025-12-02 10:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 59095e7f-870d-5a50-a160-8de614dc5b4a from tracking dictionaries
2025-12-02 10:04:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 59095e7f-870d-5a50-a160-8de614dc5b4a sending to next pipeline
2025-12-02 10:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 59095e7f-870d-5a50-a160-8de614dc5b4a, identifier: 2702180
2025-12-02 10:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfb4c90>
2025-12-02 10:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_9.jpg HTTP/1.1" 201 0
2025-12-02 10:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F94305c10-12b9-4001-8f68-dd0a128e1102_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_2.jpg saved to cache
2025-12-02 10:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dec22941-a43e-53fc-b2b3-8d383b3adbb2
2025-12-02 10:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 723d9a17-88bb-5d93-a02b-ca08decae999 with identifier: 2303707
2025-12-02 10:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 723d9a17-88bb-5d93-a02b-ca08decae999 with identifier: 2303707
2025-12-02 10:04:29 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 723d9a17-88bb-5d93-a02b-ca08decae999 with identifier: 2303707 to the API
2025-12-02 10:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 10:04:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 10:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_expert_report_file_7c8e6a2c-1674-4008-a6c6-267699a5dafb.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002303707-01985105-002.pdf',
'color': 'BLUE',
'currency': 'GBP',
'engine': '1.2L',
'expiration_date': '2025-12-04T09:00:00Z',
'fuel_type': 'Petrol',
'id': '723d9a17-88bb-5d93-a02b-ca08decae999',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KN19MKF',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/308?id=2303707',
'listing': 'auction',
'location': 'Bristol',
'make': 'PEUGEOT',
'model': '308',
'odometer': 37543,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 32,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 238163,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 238163,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242079,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216070,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 175844,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 224809,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196637,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188587,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189685,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279302,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 235417,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257061,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212286,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fbb5acf5-e45b-45f0-8203-f27be2c5fdc0_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 249550,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2303707-4004366-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271063,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2303707-4004366-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 211100,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2303707-4004366-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 267049,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2303707-4004366-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297070,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2303707-4004366-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294997,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2303707-4004366-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_723d9a17-88bb-5d93-a02b-ca08decae999/723d9a17-88bb-5d93-a02b-ca08decae999_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290582,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2303707-4004366-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-12',
'seller_name': 'Mon Motors',
'title': 'PEUGEOT 308 1.2 PureTech 130 Allure 5dr',
'transmission': 'manual',
'trim': '1.2 PureTech 130 Allure 5dr',
'year': 2019}
2025-12-02 10:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272303707%27 HTTP/1.1" 200 None
2025-12-02 10:04:29 [manheim.gb] INFO: Saving data for 2303707: {'created_time': 1764669869.786748, 'last_price_update_time': 1764669869.78676, 'auction_closing_time': 1764838800.0}
2025-12-02 10:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2303707') HTTP/1.1" 204 0
2025-12-02 10:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 59095e7f-870d-5a50-a160-8de614dc5b4a with identifier: 2702180
2025-12-02 10:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 59095e7f-870d-5a50-a160-8de614dc5b4a with identifier: 2702180
2025-12-02 10:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 21, 'seller_name': 'yeomans', 'price_includes_vat': False, 'title': 'ford kuga 2.0 tdci 163 titanium x 5dr', 'price': 0, 'currency': 'gbp', 'make': 'ford', 'model': 'kuga', 'transmission': 'manual', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 125462, 'odometer_reading_unit': 'mi', 'registration_date': '2014-04-26', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/ford/kuga?id=2702180', 'location': 'plymouth', 'origin_country_code': 'gb', 'trim': '2.0 tdci 163 titanium x 5dr', 'license_plate': 'ea14htu', 'year': 2014, 'listing': 'auction', 'c_o_2_emission_value': 154, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002702180-01985627-003.pdf', 'expiration_date': '2025-12-03t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '59095e7f-870d-5a50-a160-8de614dc5b4a', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_expert_report_file_0df0923d-0630-4049-afc0-3fa5c42e301f.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 225529}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 225529}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 264608}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 223676}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_5.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 223915}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_4.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 222547}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_11.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 214279}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_10.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 206563}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_9.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 217600}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 286513}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 179437}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 221167}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 200900}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 291566}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 238281}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 288831}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 222757}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 188086}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 272320}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 242995}], 'current_year_diff': 11, 'age_in_months': 139, 'make_model': 'ford kuga', 'sanitized_make': 'ford', 'odometer_in_km': 201911}
Failed validating None in schema:
False
On instance:
{'age_in_months': 139,
'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_expert_report_file_0df0923d-0630-4049-afc0-3fa5c42e301f.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002702180-01985627-003.pdf',
'color': 'white',
'currency': 'gbp',
'current_year_diff': 11,
'engine': '2.0l',
'expiration_date': '2025-12-03t09:00:00z',
'fuel_type': 'diesel',
'id': '59095e7f-870d-5a50-a160-8de614dc5b4a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ea14htu',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/ford/kuga?id=2702180',
'listing': 'auction',
'location': 'plymouth',
'make': 'ford',
'make_model': 'ford kuga',
'model': 'kuga',
'odometer': 125462,
'odometer_in_km': 201911,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 225529,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 225529,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 264608,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223676,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223915,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 222547,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214279,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 206563,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217600,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 286513,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179437,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 221167,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 200900,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291566,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 238281,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288831,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 222757,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188086,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272320,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242995,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-26',
'sanitized_make': 'ford',
'seller_name': 'yeomans',
'title': 'ford kuga 2.0 tdci 163 titanium x 5dr',
'transmission': 'manual',
'trim': '2.0 tdci 163 titanium x 5dr',
'year': 2014}
2025-12-02 10:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 59095e7f-870d-5a50-a160-8de614dc5b4a spider: manheim.gb
2025-12-02 10:04:30 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 59095e7f-870d-5a50-a160-8de614dc5b4a due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 21, 'seller_name': 'yeomans', 'price_includes_vat': False, 'title': 'ford kuga 2.0 tdci 163 titanium x 5dr', 'price': 0, 'currency': 'gbp', 'make': 'ford', 'model': 'kuga', 'transmission': 'manual', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 125462, 'odometer_reading_unit': 'mi', 'registration_date': '2014-04-26', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/ford/kuga?id=2702180', 'location': 'plymouth', 'origin_country_code': 'gb', 'trim': '2.0 tdci 163 titanium x 5dr', 'license_plate': 'ea14htu', 'year': 2014, 'listing': 'auction', 'c_o_2_emission_value': 154, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002702180-01985627-003.pdf', 'expiration_date': '2025-12-03t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '59095e7f-870d-5a50-a160-8de614dc5b4a', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_expert_report_file_0df0923d-0630-4049-afc0-3fa5c42e301f.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 225529}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 225529}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 264608}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 223676}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_5.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 223915}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_4.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 222547}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_11.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 214279}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_10.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 206563}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_9.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 217600}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 286513}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 179437}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 221167}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 200900}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 291566}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 238281}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 288831}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 222757}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 188086}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 272320}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 242995}], 'current_year_diff': 11, 'age_in_months': 139, 'make_model': 'ford kuga', 'sanitized_make': 'ford', 'odometer_in_km': 201911}
Failed validating None in schema:
False
On instance:
{'age_in_months': 139,
'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_expert_report_file_0df0923d-0630-4049-afc0-3fa5c42e301f.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002702180-01985627-003.pdf',
'color': 'white',
'currency': 'gbp',
'current_year_diff': 11,
'engine': '2.0l',
'expiration_date': '2025-12-03t09:00:00z',
'fuel_type': 'diesel',
'id': '59095e7f-870d-5a50-a160-8de614dc5b4a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ea14htu',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/ford/kuga?id=2702180',
'listing': 'auction',
'location': 'plymouth',
'make': 'ford',
'make_model': 'ford kuga',
'model': 'kuga',
'odometer': 125462,
'odometer_in_km': 201911,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 225529,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 225529,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 264608,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223676,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223915,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 222547,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214279,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 206563,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217600,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 286513,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179437,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 221167,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 200900,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291566,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 238281,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288831,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 222757,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188086,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272320,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242995,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-26',
'sanitized_make': 'ford',
'seller_name': 'yeomans',
'title': 'ford kuga 2.0 tdci 163 titanium x 5dr',
'transmission': 'manual',
'trim': '2.0 tdci 163 titanium x 5dr',
'year': 2014}
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_expert_report_file_0df0923d-0630-4049-afc0-3fa5c42e301f.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002702180-01985627-003.pdf',
'color': 'WHITE',
'currency': 'GBP',
'engine': '2.0L',
'expiration_date': '2025-12-03T09:00:00Z',
'fuel_type': 'Diesel',
'id': '59095e7f-870d-5a50-a160-8de614dc5b4a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EA14HTU',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/KUGA?id=2702180',
'listing': 'auction',
'location': 'Plymouth',
'make': 'FORD',
'model': 'KUGA',
'odometer': 125462,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 225529,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 225529,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 264608,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223676,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223915,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 222547,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214279,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 206563,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217600,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 286513,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179437,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 221167,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 200900,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e2b2949b-be39-4e2f-bf7e-6b3d74911b0c_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291566,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 238281,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288831,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 222757,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188086,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272320,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59095e7f-870d-5a50-a160-8de614dc5b4a/59095e7f-870d-5a50-a160-8de614dc5b4a_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242995,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2702180-4003348-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-26',
'seller_name': 'Yeomans',
'title': 'FORD KUGA 2.0 TDCi 163 Titanium X 5dr',
'transmission': 'manual',
'trim': '2.0 TDCi 163 Titanium X 5dr',
'year': 2014}
2025-12-02 10:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272702180%27 HTTP/1.1" 200 None
2025-12-02 10:04:30 [manheim.gb] INFO: Saving data for 2702180: {'created_time': 1764669870.092925, 'last_price_update_time': 1764669870.092937, 'auction_closing_time': 1764752400.0}
2025-12-02 10:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2702180') HTTP/1.1" 204 0
2025-12-02 10:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002660446-01985389-003.pdf)
2025-12-02 10:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002660446-01985389-003.pdf)
2025-12-02 10:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca9030ad0>
2025-12-02 10:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 10:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_7.jpg HTTP/1.1" 201 0
2025-12-02 10:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F94305c10-12b9-4001-8f68-dd0a128e1102_10.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_10.jpg saved to cache
2025-12-02 10:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dec22941-a43e-53fc-b2b3-8d383b3adbb2
2025-12-02 10:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8d7f750>
2025-12-02 10:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 10:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_6.jpg HTTP/1.1" 201 0
2025-12-02 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F94305c10-12b9-4001-8f68-dd0a128e1102_11.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_11.jpg saved to cache
2025-12-02 10:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dec22941-a43e-53fc-b2b3-8d383b3adbb2
2025-12-02 10:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90ba450>
2025-12-02 10:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 10:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_5.jpg HTTP/1.1" 201 0
2025-12-02 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F94305c10-12b9-4001-8f68-dd0a128e1102_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_4.jpg saved to cache
2025-12-02 10:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dec22941-a43e-53fc-b2b3-8d383b3adbb2
2025-12-02 10:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf7e590>
2025-12-02 10:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_4.jpg HTTP/1.1" 201 0
2025-12-02 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F94305c10-12b9-4001-8f68-dd0a128e1102_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_5.jpg saved to cache
2025-12-02 10:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dec22941-a43e-53fc-b2b3-8d383b3adbb2
2025-12-02 10:04:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dec22941-a43e-53fc-b2b3-8d383b3adbb2, skipping ID generation
2025-12-02 10:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Removing item dec22941-a43e-53fc-b2b3-8d383b3adbb2 from tracking dictionaries
2025-12-02 10:04:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dec22941-a43e-53fc-b2b3-8d383b3adbb2 sending to next pipeline
2025-12-02 10:04:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: dec22941-a43e-53fc-b2b3-8d383b3adbb2, identifier: 2817812
2025-12-02 10:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2660446-4003506-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002660446-01985389-003.pdf)
2025-12-02 10:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002660446-01985389-003.pdf)
2025-12-02 10:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-010.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002321815-01987253-002.pdf)
2025-12-02 10:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-011.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002321815-01987253-002.pdf)
2025-12-02 10:04:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: dec22941-a43e-53fc-b2b3-8d383b3adbb2 with identifier: 2817812
2025-12-02 10:04:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: dec22941-a43e-53fc-b2b3-8d383b3adbb2 with identifier: 2817812
2025-12-02 10:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 187739 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
187739
2025-12-02 10:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: dec22941-a43e-53fc-b2b3-8d383b3adbb2 spider: manheim.gb
2025-12-02 10:04:32 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: dec22941-a43e-53fc-b2b3-8d383b3adbb2 due to rule: high_mileage_for_country.json, error: 187739 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
187739
{'auction_title': '',
'c_o_2_emission_value': 94,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_expert_report_file_19b89bea-06e0-4bf1-b67e-b1dd2be18ac6.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002817812-01982445-005.pdf',
'color': 'SILVER',
'currency': 'GBP',
'engine': '1.5L',
'expiration_date': '2025-12-04T09:00:00Z',
'fuel_type': 'Diesel',
'id': 'dec22941-a43e-53fc-b2b3-8d383b3adbb2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KU17RRH',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/BMW/1%20SERIES?id=2817812',
'listing': 'auction',
'location': 'Leeds',
'make': 'BMW',
'model': '1 SERIES',
'odometer': 116656,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216791,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216791,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220596,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 211254,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 209483,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199531,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204251,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187963,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 205090,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 244778,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212503,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 218550,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239966,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/94305c10-12b9-4001-8f68-dd0a128e1102_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 233434,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2817812-4003117-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273324,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2817812-4003117-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 134052,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2817812-4003117-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 205491,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2817812-4003117-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214558,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2817812-4003117-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 246357,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2817812-4003117-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dec22941-a43e-53fc-b2b3-8d383b3adbb2/dec22941-a43e-53fc-b2b3-8d383b3adbb2_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 143694,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2817812-4003117-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-17',
'seller_name': 'Motor Range',
'title': 'BMW 1 SERIES 116d SE 5dr',
'transmission': 'manual',
'trim': '116d SE 5dr',
'year': 2017}
2025-12-02 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272817812%27 HTTP/1.1" 200 None
2025-12-02 10:04:32 [manheim.gb] INFO: Saving data for 2817812: {'created_time': 1764669872.205425, 'last_price_update_time': 1764669872.205438, 'auction_closing_time': 1764838800.0}
2025-12-02 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2817812') HTTP/1.1" 204 0
2025-12-02 10:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-012.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002321815-01987253-002.pdf)
2025-12-02 10:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002321815-01987253-002.pdf)
2025-12-02 10:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf6c550>
2025-12-02 10:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_12.jpg HTTP/1.1" 201 0
2025-12-02 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4291a8f3-7524-4bf3-b94d-65394501548c_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_4.jpg saved to cache
2025-12-02 10:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 1f7dfe2a-7581-5021-af0a-ac80d728d074
2025-12-02 10:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b0a6050>
2025-12-02 10:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_11.jpg HTTP/1.1" 201 0
2025-12-02 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4291a8f3-7524-4bf3-b94d-65394501548c_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_3.jpg saved to cache
2025-12-02 10:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 1f7dfe2a-7581-5021-af0a-ac80d728d074
2025-12-02 10:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b62b910>
2025-12-02 10:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_13.jpg HTTP/1.1" 201 0
2025-12-02 10:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2660446-4003506-13.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2660446-4003506-13.jpg saved to cache
2025-12-02 10:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 1f7dfe2a-7581-5021-af0a-ac80d728d074
2025-12-02 10:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8fe6550>
2025-12-02 10:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 10:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_10.jpg HTTP/1.1" 201 0
2025-12-02 10:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4291a8f3-7524-4bf3-b94d-65394501548c_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_5.jpg saved to cache
2025-12-02 10:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 1f7dfe2a-7581-5021-af0a-ac80d728d074
2025-12-02 10:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8e5b490>
2025-12-02 10:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_9.jpg HTTP/1.1" 201 0
2025-12-02 10:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2321815-9999999-335132727-010.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-010.jpg saved to cache
2025-12-02 10:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1
2025-12-02 10:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf89510>
2025-12-02 10:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_10.jpg HTTP/1.1" 201 0
2025-12-02 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2321815-9999999-335132727-011.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-011.jpg saved to cache
2025-12-02 10:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1
2025-12-02 10:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002660446-01985389-003.pdf)
2025-12-02 10:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-009.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002321815-01987253-002.pdf)
2025-12-02 10:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8fd2210>
2025-12-02 10:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_11.jpg HTTP/1.1" 201 0
2025-12-02 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2321815-9999999-335132727-012.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-012.jpg saved to cache
2025-12-02 10:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1
2025-12-02 10:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8e70910>
2025-12-02 10:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_12.jpg HTTP/1.1" 201 0
2025-12-02 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2321815-4003575-13.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-13.jpg saved to cache
2025-12-02 10:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1
2025-12-02 10:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002660446-01985389-003.pdf)
2025-12-02 10:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002660446-01985389-003.pdf)
2025-12-02 10:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002321815-01987253-002.pdf)
2025-12-02 10:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002660446-01985389-003.pdf)
2025-12-02 10:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-007.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002321815-01987253-002.pdf)
2025-12-02 10:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002321815-01987253-002.pdf)
2025-12-02 10:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002660446-01985389-003.pdf)
2025-12-02 10:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca9092710>
2025-12-02 10:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_9.jpg HTTP/1.1" 201 0
2025-12-02 10:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4291a8f3-7524-4bf3-b94d-65394501548c_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_2.jpg saved to cache
2025-12-02 10:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1f7dfe2a-7581-5021-af0a-ac80d728d074
2025-12-02 10:04:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8f08e90>
2025-12-02 10:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_8.jpg HTTP/1.1" 201 0
2025-12-02 10:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2321815-9999999-335132727-009.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-009.jpg saved to cache
2025-12-02 10:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1
2025-12-02 10:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002660446-01985389-003.pdf)
2025-12-02 10:04:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf6d590>
2025-12-02 10:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_8.jpg HTTP/1.1" 201 0
2025-12-02 10:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4291a8f3-7524-4bf3-b94d-65394501548c_9.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_9.jpg saved to cache
2025-12-02 10:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1f7dfe2a-7581-5021-af0a-ac80d728d074
2025-12-02 10:04:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8defbd0>
2025-12-02 10:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_7.jpg HTTP/1.1" 201 0
2025-12-02 10:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4291a8f3-7524-4bf3-b94d-65394501548c_10.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_10.jpg saved to cache
2025-12-02 10:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1f7dfe2a-7581-5021-af0a-ac80d728d074
2025-12-02 10:04:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf78850>
2025-12-02 10:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_6.jpg HTTP/1.1" 201 0
2025-12-02 10:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2321815-9999999-335132727-006.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-006.jpg saved to cache
2025-12-02 10:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1
2025-12-02 10:04:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90a8810>
2025-12-02 10:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 10:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_6.jpg HTTP/1.1" 201 0
2025-12-02 10:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4291a8f3-7524-4bf3-b94d-65394501548c_11.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_11.jpg saved to cache
2025-12-02 10:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1f7dfe2a-7581-5021-af0a-ac80d728d074
2025-12-02 10:04:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8d7f6d0>
2025-12-02 10:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_7.jpg HTTP/1.1" 201 0
2025-12-02 10:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2321815-9999999-335132727-007.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-007.jpg saved to cache
2025-12-02 10:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1
2025-12-02 10:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8d7cc10>
2025-12-02 10:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_5.jpg HTTP/1.1" 201 0
2025-12-02 10:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2321815-9999999-335132727-005.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-005.jpg saved to cache
2025-12-02 10:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1
2025-12-02 10:04:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1, skipping ID generation
2025-12-02 10:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1 from tracking dictionaries
2025-12-02 10:04:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1 sending to next pipeline
2025-12-02 10:04:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1, identifier: 2321815
2025-12-02 10:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b697610>
2025-12-02 10:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 10:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_3.jpg HTTP/1.1" 201 0
2025-12-02 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4291a8f3-7524-4bf3-b94d-65394501548c_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_1.jpg saved to cache
2025-12-02 10:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1f7dfe2a-7581-5021-af0a-ac80d728d074
2025-12-02 10:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002660446-01985389-003.pdf)
2025-12-02 10:04:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1 with identifier: 2321815
2025-12-02 10:04:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1 with identifier: 2321815
2025-12-02 10:04:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 28, 'seller_name': 'lookers', 'price_includes_vat': False, 'title': 'nissan note 1.5 dci acenta premium 5dr [safety pack]', 'price': 0, 'currency': 'gbp', 'make': 'nissan', 'model': 'note', 'transmission': 'manual', 'engine': '1.5l', 'fuel_type': 'diesel', 'odometer': 161455, 'odometer_reading_unit': 'mi', 'registration_date': '2014-06-29', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/note?id=2321815', 'location': 'washington', 'origin_country_code': 'gb', 'trim': '1.5 dci acenta premium 5dr [safety pack]', 'license_plate': 'ng14ety', 'year': 2014, 'listing': 'auction', 'c_o_2_emission_value': 92, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002321815-01987253-002.pdf', 'expiration_date': '2025-12-03t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '21bf0f9e-c7ae-55f1-952b-3c7d2caddad1', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_expert_report_file_6f239cf3-065a-4d3d-8910-3d014aec9187.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 273178}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-008.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 240990}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 299177}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 281178}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 289788}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 262435}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-006.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 254097}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-007.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 298043}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-009.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 310584}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-010.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 228486}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-011.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 242962}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-012.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 335508}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-13.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 354027}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1000.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 195886}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1001.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 352529}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1002.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 179206}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1003.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 245533}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1004.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 388686}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1005.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 155217}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1006.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 191858}], 'current_year_diff': 11, 'age_in_months': 137, 'make_model': 'nissan note', 'sanitized_make': 'nissan', 'odometer_in_km': 259835}
Failed validating None in schema:
False
On instance:
{'age_in_months': 137,
'auction_title': '',
'c_o_2_emission_value': 92,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_expert_report_file_6f239cf3-065a-4d3d-8910-3d014aec9187.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002321815-01987253-002.pdf',
'color': 'blue',
'currency': 'gbp',
'current_year_diff': 11,
'engine': '1.5l',
'expiration_date': '2025-12-03t09:00:00z',
'fuel_type': 'diesel',
'id': '21bf0f9e-c7ae-55f1-952b-3c7d2caddad1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ng14ety',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/note?id=2321815',
'listing': 'auction',
'location': 'washington',
'make': 'nissan',
'make_model': 'nissan note',
'model': 'note',
'odometer': 161455,
'odometer_in_km': 259835,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273178,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 240990,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-008.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299177,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281178,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289788,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 262435,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-005.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 254097,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-006.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298043,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-007.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310584,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-009.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 228486,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-010.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242962,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-011.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335508,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-012.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354027,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-13.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195886,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1000.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352529,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1001.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179206,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1002.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245533,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1003.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388686,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1004.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 155217,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1005.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 191858,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1006.jpg',
'Width': 1500}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-29',
'sanitized_make': 'nissan',
'seller_name': 'lookers',
'title': 'nissan note 1.5 dci acenta premium 5dr [safety pack]',
'transmission': 'manual',
'trim': '1.5 dci acenta premium 5dr [safety pack]',
'year': 2014}
2025-12-02 10:04:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1 spider: manheim.gb
2025-12-02 10:04:38 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 21bf0f9e-c7ae-55f1-952b-3c7d2caddad1 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 28, 'seller_name': 'lookers', 'price_includes_vat': False, 'title': 'nissan note 1.5 dci acenta premium 5dr [safety pack]', 'price': 0, 'currency': 'gbp', 'make': 'nissan', 'model': 'note', 'transmission': 'manual', 'engine': '1.5l', 'fuel_type': 'diesel', 'odometer': 161455, 'odometer_reading_unit': 'mi', 'registration_date': '2014-06-29', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/note?id=2321815', 'location': 'washington', 'origin_country_code': 'gb', 'trim': '1.5 dci acenta premium 5dr [safety pack]', 'license_plate': 'ng14ety', 'year': 2014, 'listing': 'auction', 'c_o_2_emission_value': 92, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002321815-01987253-002.pdf', 'expiration_date': '2025-12-03t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '21bf0f9e-c7ae-55f1-952b-3c7d2caddad1', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_expert_report_file_6f239cf3-065a-4d3d-8910-3d014aec9187.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 273178}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-008.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 240990}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 299177}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 281178}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 289788}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 262435}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-006.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 254097}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-007.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 298043}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-009.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 310584}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-010.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 228486}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-011.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 242962}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-012.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 335508}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-13.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 354027}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1000.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 195886}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1001.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 352529}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1002.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 179206}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1003.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 245533}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1004.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 388686}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1005.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 155217}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1006.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 191858}], 'current_year_diff': 11, 'age_in_months': 137, 'make_model': 'nissan note', 'sanitized_make': 'nissan', 'odometer_in_km': 259835}
Failed validating None in schema:
False
On instance:
{'age_in_months': 137,
'auction_title': '',
'c_o_2_emission_value': 92,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_expert_report_file_6f239cf3-065a-4d3d-8910-3d014aec9187.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002321815-01987253-002.pdf',
'color': 'blue',
'currency': 'gbp',
'current_year_diff': 11,
'engine': '1.5l',
'expiration_date': '2025-12-03t09:00:00z',
'fuel_type': 'diesel',
'id': '21bf0f9e-c7ae-55f1-952b-3c7d2caddad1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ng14ety',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/note?id=2321815',
'listing': 'auction',
'location': 'washington',
'make': 'nissan',
'make_model': 'nissan note',
'model': 'note',
'odometer': 161455,
'odometer_in_km': 259835,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273178,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 240990,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-008.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299177,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281178,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289788,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 262435,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-005.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 254097,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-006.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298043,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-007.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310584,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-009.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 228486,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-010.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242962,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-011.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335508,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-012.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354027,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-13.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195886,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1000.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352529,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1001.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179206,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1002.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245533,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1003.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388686,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1004.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 155217,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1005.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 191858,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1006.jpg',
'Width': 1500}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-29',
'sanitized_make': 'nissan',
'seller_name': 'lookers',
'title': 'nissan note 1.5 dci acenta premium 5dr [safety pack]',
'transmission': 'manual',
'trim': '1.5 dci acenta premium 5dr [safety pack]',
'year': 2014}
{'auction_title': '',
'c_o_2_emission_value': 92,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_expert_report_file_6f239cf3-065a-4d3d-8910-3d014aec9187.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002321815-01987253-002.pdf',
'color': 'BLUE',
'currency': 'GBP',
'engine': '1.5L',
'expiration_date': '2025-12-03T09:00:00Z',
'fuel_type': 'Diesel',
'id': '21bf0f9e-c7ae-55f1-952b-3c7d2caddad1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NG14ETY',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/NOTE?id=2321815',
'listing': 'auction',
'location': 'Washington',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 161455,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273178,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 240990,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-008.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299177,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281178,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289788,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 262435,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-005.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 254097,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-006.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298043,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-007.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310584,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-009.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 228486,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-010.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242962,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-011.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335508,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2321815-9999999-335132727-012.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354027,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-13.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195886,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1000.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352529,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1001.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179206,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1002.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245533,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1003.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388686,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1004.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 155217,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1005.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf0f9e-c7ae-55f1-952b-3c7d2caddad1/21bf0f9e-c7ae-55f1-952b-3c7d2caddad1_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 191858,
'Height': 937,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2321815-4003575-1006.jpg',
'Width': 1500}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-29',
'seller_name': 'Lookers',
'title': 'NISSAN NOTE 1.5 dCi Acenta Premium 5dr [Safety Pack]',
'transmission': 'manual',
'trim': '1.5 dCi Acenta Premium 5dr [Safety Pack]',
'year': 2014}
2025-12-02 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272321815%27 HTTP/1.1" 200 None
2025-12-02 10:04:38 [manheim.gb] INFO: Saving data for 2321815: {'created_time': 1764669878.270285, 'last_price_update_time': 1764669878.270297, 'auction_closing_time': 1764752400.0}
2025-12-02 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2321815') HTTP/1.1" 204 0
2025-12-02 10:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf90e90>
2025-12-02 10:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_5.jpg HTTP/1.1" 201 0
2025-12-02 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4291a8f3-7524-4bf3-b94d-65394501548c_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_4.jpg saved to cache
2025-12-02 10:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1f7dfe2a-7581-5021-af0a-ac80d728d074
2025-12-02 10:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b608710>
2025-12-02 10:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 10:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_2.jpg HTTP/1.1" 201 0
2025-12-02 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4291a8f3-7524-4bf3-b94d-65394501548c_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_6.jpg saved to cache
2025-12-02 10:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1f7dfe2a-7581-5021-af0a-ac80d728d074
2025-12-02 10:04:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f7dfe2a-7581-5021-af0a-ac80d728d074, skipping ID generation
2025-12-02 10:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1f7dfe2a-7581-5021-af0a-ac80d728d074 from tracking dictionaries
2025-12-02 10:04:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f7dfe2a-7581-5021-af0a-ac80d728d074 sending to next pipeline
2025-12-02 10:04:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 1f7dfe2a-7581-5021-af0a-ac80d728d074, identifier: 2660446
2025-12-02 10:04:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 1f7dfe2a-7581-5021-af0a-ac80d728d074 with identifier: 2660446
2025-12-02 10:04:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 1f7dfe2a-7581-5021-af0a-ac80d728d074 with identifier: 2660446
2025-12-02 10:04:39 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 1f7dfe2a-7581-5021-af0a-ac80d728d074 with identifier: 2660446 to the API
2025-12-02 10:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 10:04:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 10:04:39 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_expert_report_file_c3ebda8e-2f72-4395-854c-012b50544d60.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002660446-01985389-003.pdf',
'color': 'RED',
'currency': 'GBP',
'engine': '1.2L',
'expiration_date': '2025-12-03T09:00:00Z',
'fuel_type': 'Petrol',
'id': '1f7dfe2a-7581-5021-af0a-ac80d728d074',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FH66YSW',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/GRAND%20C4%20PICASSO?id=2660446',
'listing': 'auction',
'location': 'Plymouth',
'make': 'CITROEN',
'model': 'GRAND C4 PICASSO',
'odometer': 37059,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223981,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223981,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 276742,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99212,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223031,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217607,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220726,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 215360,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 208587,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 262346,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 236702,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 221964,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 208280,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4291a8f3-7524-4bf3-b94d-65394501548c_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316658,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2660446-4003506-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277678,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2660446-4003506-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331297,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2660446-4003506-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 325198,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2660446-4003506-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283376,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2660446-4003506-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7dfe2a-7581-5021-af0a-ac80d728d074/1f7dfe2a-7581-5021-af0a-ac80d728d074_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297857,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2660446-4003506-1004.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-27',
'seller_name': 'Startline Motor Finance',
'title': 'CITROEN GRAND C4 PICASSO 1.2 PureTech Flair 5dr EAT6',
'transmission': 'automatic',
'trim': '1.2 PureTech Flair 5dr EAT6',
'year': 2017}
2025-12-02 10:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272660446%27 HTTP/1.1" 200 None
2025-12-02 10:04:39 [manheim.gb] INFO: Saving data for 2660446: {'created_time': 1764669879.424154, 'last_price_update_time': 1764669879.424165, 'auction_closing_time': 1764752400.0}
2025-12-02 10:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2660446') HTTP/1.1" 204 0
2025-12-02 10:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002830703-01958961-003.pdf> (referer: None)
2025-12-02 10:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002303945-01989557-002.pdf> (referer: None)
2025-12-02 10:04:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b0b0890>
2025-12-02 10:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_expert_report_file_5ac7ef86-77ac-41f8-b643-08f86fd9934b.pdf HTTP/1.1" 201 0
2025-12-02 10:04:39 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 79f1a13d-7203-5b0f-8b79-f7b133941800
2025-12-02 10:04:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79f1a13d-7203-5b0f-8b79-f7b133941800, skipping ID generation
2025-12-02 10:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 79f1a13d-7203-5b0f-8b79-f7b133941800
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_7.jpg already downloaded
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_7.jpg already downloaded
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_6.jpg already downloaded
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_1.jpg already downloaded
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7881ad0f-c94a-4379-9e82-197fce0e98ea_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_5.jpg already downloaded
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7881ad0f-c94a-4379-9e82-197fce0e98ea_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_4.jpg already downloaded
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7881ad0f-c94a-4379-9e82-197fce0e98ea_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_11.jpg already downloaded
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7881ad0f-c94a-4379-9e82-197fce0e98ea_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_10.jpg already downloaded
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7881ad0f-c94a-4379-9e82-197fce0e98ea_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_9.jpg already downloaded
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_2.jpg already downloaded
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_5.jpg already downloaded
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_3.jpg already downloaded
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_4.jpg already downloaded
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2830703-3970429-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-13.jpg already downloaded
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2830703-3970429-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1000.jpg already downloaded
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2830703-3970429-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1001.jpg already downloaded
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2830703-3970429-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1002.jpg already downloaded
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2830703-3970429-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1003.jpg already downloaded
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2830703-3970429-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1004.jpg already downloaded
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2830703-3970429-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1005.jpg already downloaded
2025-12-02 10:04:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 79f1a13d-7203-5b0f-8b79-f7b133941800, identifier: 2830703
2025-12-02 10:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ea7c90>
2025-12-02 10:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_expert_report_file_0baaa8bc-d28e-4672-bb7b-e67ecbdf9bb8.pdf HTTP/1.1" 201 0
2025-12-02 10:04:41 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 972ab119-db10-56e3-9ac0-82a1791b387f
2025-12-02 10:04:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 972ab119-db10-56e3-9ac0-82a1791b387f, skipping ID generation
2025-12-02 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 972ab119-db10-56e3-9ac0-82a1791b387f
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf8c73ea-8fac-4886-af72-a771cfc8675a_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_7.jpg not downloaded yet
2025-12-02 10:04:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 79f1a13d-7203-5b0f-8b79-f7b133941800 with identifier: 2830703
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Silver HTTP/1.1" 200 None
2025-12-02 10:04:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 10:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 79f1a13d-7203-5b0f-8b79-f7b133941800 with identifier: 2830703
2025-12-02 10:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 35, 'seller_name': None, 'price_includes_vat': False, 'title': 'mini hatchback 1.5 cooper d 5dr', 'price': 0, 'currency': 'gbp', 'make': 'mini', 'model': 'hatchback', 'transmission': 'manual', 'engine': '1.5l', 'fuel_type': 'diesel', 'odometer': 140834, 'odometer_reading_unit': 'mi', 'registration_date': '2016-03-22', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/mini/hatchback?id=2830703', 'location': 'colchester', 'origin_country_code': 'gb', 'trim': '1.5 cooper d 5dr', 'license_plate': 'oy16gda', 'year': 2016, 'listing': 'auction', 'c_o_2_emission_value': 95, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002830703-01958961-003.pdf', 'expiration_date': '2025-12-04t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_7.jpg', 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_7.jpg', 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_6.jpg', 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_1.jpg', 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_5.jpg', 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_4.jpg', 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_11.jpg', 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_10.jpg', 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_9.jpg', 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_2.jpg', 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_5.jpg', 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_3.jpg', 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_4.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-13.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1000.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1001.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1002.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1003.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1004.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1005.jpg'], 'id': '79f1a13d-7203-5b0f-8b79-f7b133941800', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_expert_report_file_5ac7ef86-77ac-41f8-b643-08f86fd9934b.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 239206}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 239206}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 272247}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 212575}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 183440}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 174415}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 191615}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 181792}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 194597}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 201169}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 189610}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 136400}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 237954}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 360313}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 221358}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 197417}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 302648}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 195211}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 243651}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 287813}], 'current_year_diff': 9, 'age_in_months': 116, 'make_model': 'mini hatchback', 'sanitized_make': 'mini', 'odometer_in_km': 226649}
Failed validating None in schema:
False
On instance:
{'age_in_months': 116,
'auction_title': '',
'c_o_2_emission_value': 95,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_expert_report_file_5ac7ef86-77ac-41f8-b643-08f86fd9934b.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002830703-01958961-003.pdf',
'color': 'silver',
'currency': 'gbp',
'current_year_diff': 9,
'engine': '1.5l',
'expiration_date': '2025-12-04t09:00:00z',
'fuel_type': 'diesel',
'id': '79f1a13d-7203-5b0f-8b79-f7b133941800',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'oy16gda',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/mini/hatchback?id=2830703',
'listing': 'auction',
'location': 'colchester',
'make': 'mini',
'make_model': 'mini hatchback',
'model': 'hatchback',
'odometer': 140834,
'odometer_in_km': 226649,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 35,
'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_7.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_7.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_6.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_1.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_5.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_4.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_11.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_10.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_9.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_2.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_5.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_3.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_4.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-13.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1000.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1001.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1002.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1003.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1004.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1005.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239206,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239206,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272247,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212575,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 183440,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 174415,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 191615,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181792,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 194597,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 201169,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189610,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 136400,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237954,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360313,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 221358,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197417,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302648,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195211,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 243651,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287813,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-22',
'sanitized_make': 'mini',
'seller_name': None,
'title': 'mini hatchback 1.5 cooper d 5dr',
'transmission': 'manual',
'trim': '1.5 cooper d 5dr',
'year': 2016}
2025-12-02 10:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 79f1a13d-7203-5b0f-8b79-f7b133941800 spider: manheim.gb
2025-12-02 10:04:41 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 79f1a13d-7203-5b0f-8b79-f7b133941800 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 35, 'seller_name': None, 'price_includes_vat': False, 'title': 'mini hatchback 1.5 cooper d 5dr', 'price': 0, 'currency': 'gbp', 'make': 'mini', 'model': 'hatchback', 'transmission': 'manual', 'engine': '1.5l', 'fuel_type': 'diesel', 'odometer': 140834, 'odometer_reading_unit': 'mi', 'registration_date': '2016-03-22', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/mini/hatchback?id=2830703', 'location': 'colchester', 'origin_country_code': 'gb', 'trim': '1.5 cooper d 5dr', 'license_plate': 'oy16gda', 'year': 2016, 'listing': 'auction', 'c_o_2_emission_value': 95, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002830703-01958961-003.pdf', 'expiration_date': '2025-12-04t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_7.jpg', 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_7.jpg', 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_6.jpg', 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_1.jpg', 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_5.jpg', 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_4.jpg', 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_11.jpg', 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_10.jpg', 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_9.jpg', 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_2.jpg', 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_5.jpg', 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_3.jpg', 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_4.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-13.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1000.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1001.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1002.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1003.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1004.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1005.jpg'], 'id': '79f1a13d-7203-5b0f-8b79-f7b133941800', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_expert_report_file_5ac7ef86-77ac-41f8-b643-08f86fd9934b.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 239206}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 239206}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 272247}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 212575}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 183440}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 174415}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 191615}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 181792}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 194597}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 201169}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 189610}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 136400}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 237954}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 360313}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 221358}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 197417}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 302648}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 195211}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 243651}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 287813}], 'current_year_diff': 9, 'age_in_months': 116, 'make_model': 'mini hatchback', 'sanitized_make': 'mini', 'odometer_in_km': 226649}
Failed validating None in schema:
False
On instance:
{'age_in_months': 116,
'auction_title': '',
'c_o_2_emission_value': 95,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_expert_report_file_5ac7ef86-77ac-41f8-b643-08f86fd9934b.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002830703-01958961-003.pdf',
'color': 'silver',
'currency': 'gbp',
'current_year_diff': 9,
'engine': '1.5l',
'expiration_date': '2025-12-04t09:00:00z',
'fuel_type': 'diesel',
'id': '79f1a13d-7203-5b0f-8b79-f7b133941800',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'oy16gda',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/mini/hatchback?id=2830703',
'listing': 'auction',
'location': 'colchester',
'make': 'mini',
'make_model': 'mini hatchback',
'model': 'hatchback',
'odometer': 140834,
'odometer_in_km': 226649,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 35,
'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_7.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_7.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_6.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_1.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_5.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_4.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_11.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_10.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_9.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_2.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_5.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_3.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_4.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-13.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1000.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1001.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1002.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1003.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1004.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1005.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239206,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239206,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272247,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212575,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 183440,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 174415,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 191615,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181792,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 194597,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 201169,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189610,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 136400,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237954,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360313,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 221358,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197417,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302648,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195211,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 243651,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287813,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-22',
'sanitized_make': 'mini',
'seller_name': None,
'title': 'mini hatchback 1.5 cooper d 5dr',
'transmission': 'manual',
'trim': '1.5 cooper d 5dr',
'year': 2016}
{'auction_title': '',
'c_o_2_emission_value': 95,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_expert_report_file_5ac7ef86-77ac-41f8-b643-08f86fd9934b.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002830703-01958961-003.pdf',
'color': 'Silver',
'currency': 'GBP',
'engine': '1.5L',
'expiration_date': '2025-12-04T09:00:00Z',
'fuel_type': 'Diesel',
'id': '79f1a13d-7203-5b0f-8b79-f7b133941800',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OY16GDA',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MINI/HATCHBACK?id=2830703',
'listing': 'auction',
'location': 'Colchester',
'make': 'MINI',
'model': 'HATCHBACK',
'odometer': 140834,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 35,
'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_7.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_7.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_6.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_1.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_5.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_4.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_11.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_10.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_9.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_2.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_5.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_3.jpg',
'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_4.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-13.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1000.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1001.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1002.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1003.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1004.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1005.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239206,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239206,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272247,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212575,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 183440,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 174415,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 191615,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181792,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 194597,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 201169,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189610,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 136400,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237954,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7881ad0f-c94a-4379-9e82-197fce0e98ea_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360313,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 221358,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197417,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302648,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195211,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 243651,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f1a13d-7203-5b0f-8b79-f7b133941800/79f1a13d-7203-5b0f-8b79-f7b133941800_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287813,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2830703-3970429-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-22',
'seller_name': None,
'title': 'MINI HATCHBACK 1.5 Cooper D 5dr',
'transmission': 'manual',
'trim': '1.5 Cooper D 5dr',
'year': 2016}
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272830703%27 HTTP/1.1" 200 None
2025-12-02 10:04:41 [manheim.gb] INFO: Saving data for 2830703: {'created_time': 1764669881.44208, 'last_price_update_time': 1764669881.44209, 'auction_closing_time': 1764838800.0}
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2830703') HTTP/1.1" 204 0
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf8c73ea-8fac-4886-af72-a771cfc8675a_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_7.jpg not downloaded yet
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf8c73ea-8fac-4886-af72-a771cfc8675a_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_6.jpg not downloaded yet
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf8c73ea-8fac-4886-af72-a771cfc8675a_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_1.jpg not downloaded yet
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf8c73ea-8fac-4886-af72-a771cfc8675a_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_5.jpg not downloaded yet
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf8c73ea-8fac-4886-af72-a771cfc8675a_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_4.jpg not downloaded yet
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf8c73ea-8fac-4886-af72-a771cfc8675a_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_11.jpg not downloaded yet
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf8c73ea-8fac-4886-af72-a771cfc8675a_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_10.jpg not downloaded yet
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf8c73ea-8fac-4886-af72-a771cfc8675a_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_9.jpg not downloaded yet
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf8c73ea-8fac-4886-af72-a771cfc8675a_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_2.jpg not downloaded yet
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf8c73ea-8fac-4886-af72-a771cfc8675a_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_5.jpg not downloaded yet
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf8c73ea-8fac-4886-af72-a771cfc8675a_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_3.jpg not downloaded yet
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf8c73ea-8fac-4886-af72-a771cfc8675a_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_4.jpg not downloaded yet
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2303945-4003269-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2303945-4003269-13.jpg not downloaded yet
2025-12-02 10:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303945-01989557-002.pdf)
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2303945-4003269-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2303945-4003269-1000.jpg not downloaded yet
2025-12-02 10:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303945-01989557-002.pdf)
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2303945-4003269-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2303945-4003269-1001.jpg not downloaded yet
2025-12-02 10:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303945-01989557-002.pdf)
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2303945-4003269-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2303945-4003269-1002.jpg not downloaded yet
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2303945-4003269-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2303945-4003269-1003.jpg not downloaded yet
2025-12-02 10:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303945-01989557-002.pdf)
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2303945-4003269-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2303945-4003269-1004.jpg not downloaded yet
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2303945-4003269-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 10:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2303945-4003269-1005.jpg not downloaded yet
2025-12-02 10:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303945-01989557-002.pdf)
2025-12-02 10:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6eea50>
2025-12-02 10:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_1.jpg HTTP/1.1" 201 0
2025-12-02 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf8c73ea-8fac-4886-af72-a771cfc8675a_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_7.jpg saved to cache
2025-12-02 10:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 972ab119-db10-56e3-9ac0-82a1791b387f
2025-12-02 10:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303945-01989557-002.pdf)
2025-12-02 10:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303945-01989557-002.pdf)
2025-12-02 10:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303945-01989557-002.pdf)
2025-12-02 10:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303945-01989557-002.pdf)
2025-12-02 10:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303945-01989557-002.pdf)
2025-12-02 10:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303945-01989557-002.pdf)
2025-12-02 10:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303945-01989557-002.pdf)
2025-12-02 10:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6cb950>
2025-12-02 10:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_0.jpg HTTP/1.1" 201 0
2025-12-02 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf8c73ea-8fac-4886-af72-a771cfc8675a_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_7.jpg saved to cache
2025-12-02 10:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 972ab119-db10-56e3-9ac0-82a1791b387f
2025-12-02 10:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8d47150>
2025-12-02 10:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_2.jpg HTTP/1.1" 201 0
2025-12-02 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf8c73ea-8fac-4886-af72-a771cfc8675a_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_6.jpg saved to cache
2025-12-02 10:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 972ab119-db10-56e3-9ac0-82a1791b387f
2025-12-02 10:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4caa5433d0>
2025-12-02 10:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_3.jpg HTTP/1.1" 201 0
2025-12-02 10:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf8c73ea-8fac-4886-af72-a771cfc8675a_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_1.jpg saved to cache
2025-12-02 10:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 972ab119-db10-56e3-9ac0-82a1791b387f
2025-12-02 10:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf5e890>
2025-12-02 10:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_4.jpg HTTP/1.1" 201 0
2025-12-02 10:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf8c73ea-8fac-4886-af72-a771cfc8675a_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_5.jpg saved to cache
2025-12-02 10:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 972ab119-db10-56e3-9ac0-82a1791b387f
2025-12-02 10:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303945-01989557-002.pdf)
2025-12-02 10:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2303945-4003269-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303945-01989557-002.pdf)
2025-12-02 10:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8d7fc50>
2025-12-02 10:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_6.jpg HTTP/1.1" 201 0
2025-12-02 10:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf8c73ea-8fac-4886-af72-a771cfc8675a_11.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_11.jpg saved to cache
2025-12-02 10:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 972ab119-db10-56e3-9ac0-82a1791b387f
2025-12-02 10:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca88d7c50>
2025-12-02 10:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_5.jpg HTTP/1.1" 201 0
2025-12-02 10:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf8c73ea-8fac-4886-af72-a771cfc8675a_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_4.jpg saved to cache
2025-12-02 10:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 972ab119-db10-56e3-9ac0-82a1791b387f
2025-12-02 10:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90f2a10>
2025-12-02 10:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 10:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_7.jpg HTTP/1.1" 201 0
2025-12-02 10:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf8c73ea-8fac-4886-af72-a771cfc8675a_10.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_10.jpg saved to cache
2025-12-02 10:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 972ab119-db10-56e3-9ac0-82a1791b387f
2025-12-02 10:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90f3a90>
2025-12-02 10:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_8.jpg HTTP/1.1" 201 0
2025-12-02 10:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf8c73ea-8fac-4886-af72-a771cfc8675a_9.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_9.jpg saved to cache
2025-12-02 10:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 972ab119-db10-56e3-9ac0-82a1791b387f
2025-12-02 10:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca90f22d0>
2025-12-02 10:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_10.jpg HTTP/1.1" 201 0
2025-12-02 10:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf8c73ea-8fac-4886-af72-a771cfc8675a_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_5.jpg saved to cache
2025-12-02 10:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 972ab119-db10-56e3-9ac0-82a1791b387f
2025-12-02 10:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ede190>
2025-12-02 10:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 10:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_12.jpg HTTP/1.1" 201 0
2025-12-02 10:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf8c73ea-8fac-4886-af72-a771cfc8675a_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_4.jpg saved to cache
2025-12-02 10:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 972ab119-db10-56e3-9ac0-82a1791b387f
2025-12-02 10:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca88d2090>
2025-12-02 10:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_11.jpg HTTP/1.1" 201 0
2025-12-02 10:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf8c73ea-8fac-4886-af72-a771cfc8675a_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_3.jpg saved to cache
2025-12-02 10:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 972ab119-db10-56e3-9ac0-82a1791b387f
2025-12-02 10:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2303945-4003269-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303945-01989557-002.pdf)
2025-12-02 10:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2303945-4003269-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303945-01989557-002.pdf)
2025-12-02 10:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2303945-4003269-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303945-01989557-002.pdf)
2025-12-02 10:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2303945-4003269-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303945-01989557-002.pdf)
2025-12-02 10:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2303945-4003269-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303945-01989557-002.pdf)
2025-12-02 10:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8ebea10>
2025-12-02 10:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 10:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_9.jpg HTTP/1.1" 201 0
2025-12-02 10:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdf8c73ea-8fac-4886-af72-a771cfc8675a_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_2.jpg saved to cache
2025-12-02 10:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 972ab119-db10-56e3-9ac0-82a1791b387f
2025-12-02 10:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4ca8f69f10>
2025-12-02 10:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_14.jpg HTTP/1.1" 201 0
2025-12-02 10:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2303945-4003269-1000.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2303945-4003269-1000.jpg saved to cache
2025-12-02 10:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 972ab119-db10-56e3-9ac0-82a1791b387f
2025-12-02 10:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2303945-4003269-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002303945-01989557-002.pdf)
2025-12-02 10:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bfaac50>
2025-12-02 10:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_16.jpg HTTP/1.1" 201 0
2025-12-02 10:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2303945-4003269-1002.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2303945-4003269-1002.jpg saved to cache
2025-12-02 10:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 972ab119-db10-56e3-9ac0-82a1791b387f
2025-12-02 10:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf6ded0>
2025-12-02 10:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 10:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_17.jpg HTTP/1.1" 201 0
2025-12-02 10:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2303945-4003269-1003.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2303945-4003269-1003.jpg saved to cache
2025-12-02 10:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 972ab119-db10-56e3-9ac0-82a1791b387f
2025-12-02 10:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b64c910>
2025-12-02 10:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 10:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_19.jpg HTTP/1.1" 201 0
2025-12-02 10:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2303945-4003269-1005.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2303945-4003269-1005.jpg saved to cache
2025-12-02 10:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 972ab119-db10-56e3-9ac0-82a1791b387f
2025-12-02 10:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b6d90d0>
2025-12-02 10:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 10:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_15.jpg HTTP/1.1" 201 0
2025-12-02 10:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2303945-4003269-1001.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2303945-4003269-1001.jpg saved to cache
2025-12-02 10:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 972ab119-db10-56e3-9ac0-82a1791b387f
2025-12-02 10:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9bf66d90>
2025-12-02 10:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_13.jpg HTTP/1.1" 201 0
2025-12-02 10:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2303945-4003269-13.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2303945-4003269-13.jpg saved to cache
2025-12-02 10:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 972ab119-db10-56e3-9ac0-82a1791b387f
2025-12-02 10:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 10:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 10:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 10:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c9b0b2c90>
2025-12-02 10:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 10:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 10:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 10:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 10:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 10:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 10:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_18.jpg HTTP/1.1" 201 0
2025-12-02 10:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2303945-4003269-1004.jpg') HTTP/1.1" 204 0
2025-12-02 10:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2303945-4003269-1004.jpg saved to cache
2025-12-02 10:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 972ab119-db10-56e3-9ac0-82a1791b387f
2025-12-02 10:04:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 972ab119-db10-56e3-9ac0-82a1791b387f, skipping ID generation
2025-12-02 10:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 972ab119-db10-56e3-9ac0-82a1791b387f from tracking dictionaries
2025-12-02 10:04:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 972ab119-db10-56e3-9ac0-82a1791b387f sending to next pipeline
2025-12-02 10:04:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 972ab119-db10-56e3-9ac0-82a1791b387f, identifier: 2303945
2025-12-02 10:04:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 972ab119-db10-56e3-9ac0-82a1791b387f with identifier: 2303945
2025-12-02 10:04:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 972ab119-db10-56e3-9ac0-82a1791b387f with identifier: 2303945
2025-12-02 10:04:48 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 972ab119-db10-56e3-9ac0-82a1791b387f with expiration date: 2025-12-02T09:00:00Z
{'auction_title': '',
'c_o_2_emission_value': 94,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_expert_report_file_0baaa8bc-d28e-4672-bb7b-e67ecbdf9bb8.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002303945-01989557-002.pdf',
'color': 'BLACK',
'currency': 'GBP',
'engine': '2.0L',
'expiration_date': '2025-12-02T09:00:00Z',
'fuel_type': 'Diesel',
'id': '972ab119-db10-56e3-9ac0-82a1791b387f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YE16HGZ',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLVO/V40?id=2303945',
'listing': 'auction',
'location': 'Manchester',
'make': 'VOLVO',
'model': 'V40',
'odometer': 76356,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 34,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180378,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180378,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 248653,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189435,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181254,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181667,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172563,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 173163,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179027,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277629,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168794,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 205535,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179811,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/df8c73ea-8fac-4886-af72-a771cfc8675a_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 450156,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2303945-4003269-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192876,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2303945-4003269-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335422,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2303945-4003269-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 276491,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2303945-4003269-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 325634,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2303945-4003269-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374762,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2303945-4003269-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_972ab119-db10-56e3-9ac0-82a1791b387f/972ab119-db10-56e3-9ac0-82a1791b387f_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368957,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2303945-4003269-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-21',
'seller_name': 'Fords Of Winsford LTD',
'title': 'VOLVO V40 D2 [120] R DESIGN 5dr',
'transmission': 'manual',
'trim': 'D2 [120] R DESIGN 5dr',
'year': 2016}
2025-12-02 10:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272303945%27 HTTP/1.1" 200 None
2025-12-02 10:04:48 [manheim.gb] INFO: Saving data for 2303945: {'created_time': 1764669888.358682, 'last_price_update_time': 1764669888.358694, 'auction_closing_time': 1764666000.0}
2025-12-02 10:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2303945') HTTP/1.1" 204 0
2025-12-02 10:04:48 [scrapy.core.engine] INFO: Closing spider (finished)
2025-12-02 10:04:48 [manheim.gb] INFO: manheim.gb Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 1, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 1}
2025-12-02 10:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272933109%27 HTTP/1.1" 200 None
2025-12-02 10:04:48 [manheim.gb] INFO: Saving data for 2933109: {'created_time': 1764669888.540277}
2025-12-02 10:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2933109') HTTP/1.1" 204 0
2025-12-02 10:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 10:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20last_price_update_time%20lt%201764237888 HTTP/1.1" 200 None
2025-12-02 10:04:48 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (12 items) in: file:///var/lib/scrapyd/items/sourcing_v2/manheim.gb/task_37_2025-12-02T10_00_03.jl
2025-12-02 10:04:48 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 643091,
'downloader/request_count': 500,
'downloader/request_method_count/GET': 497,
'downloader/request_method_count/POST': 3,
'downloader/response_bytes': 200332207,
'downloader/response_count': 500,
'downloader/response_status_count/200': 500,
'elapsed_time_seconds': 267.694341,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2025, 12, 2, 10, 4, 48, 602459, tzinfo=datetime.timezone.utc),
'item_dropped_count': 18,
'item_dropped_reasons_count/DropItem': 18,
'item_scraped_count': 12,
'log_count/DEBUG': 5578,
'log_count/ERROR': 8,
'log_count/INFO': 4947,
'memusage/max': 196861952,
'memusage/startup': 127176704,
'photo_download_count': 439,
'playwright/context_count': 1,
'playwright/context_count/max_concurrent': 1,
'playwright/context_count/persistent/False': 1,
'playwright/context_count/remote/False': 1,
'playwright/page_count': 1,
'playwright/page_count/max_concurrent': 1,
'playwright/request_count': 85,
'playwright/request_count/aborted': 47,
'playwright/request_count/method/GET': 82,
'playwright/request_count/method/POST': 3,
'playwright/request_count/navigation': 4,
'playwright/request_count/resource_type/document': 4,
'playwright/request_count/resource_type/font': 8,
'playwright/request_count/resource_type/image': 41,
'playwright/request_count/resource_type/script': 22,
'playwright/request_count/resource_type/stylesheet': 8,
'playwright/request_count/resource_type/xhr': 2,
'playwright/response_count': 38,
'playwright/response_count/method/GET': 35,
'playwright/response_count/method/POST': 3,
'playwright/response_count/resource_type/document': 4,
'playwright/response_count/resource_type/font': 8,
'playwright/response_count/resource_type/script': 16,
'playwright/response_count/resource_type/stylesheet': 8,
'playwright/response_count/resource_type/xhr': 2,
'request_depth_max': 5,
'response_received_count': 61,
'scheduler/dequeued': 500,
'scheduler/dequeued/memory': 500,
'scheduler/enqueued': 500,
'scheduler/enqueued/memory': 500,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 33,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 34.27760354285905,
'scrapy-zyte-api/mean_response_seconds': 34.5189908265108,
'scrapy-zyte-api/processed': 33,
'scrapy-zyte-api/request_args/actions': 30,
'scrapy-zyte-api/request_args/browserHtml': 30,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 3,
'scrapy-zyte-api/request_args/experimental.requestCookies': 33,
'scrapy-zyte-api/request_args/experimental.responseCookies': 33,
'scrapy-zyte-api/request_args/httpRequestBody': 3,
'scrapy-zyte-api/request_args/httpRequestMethod': 3,
'scrapy-zyte-api/request_args/httpResponseBody': 3,
'scrapy-zyte-api/request_args/httpResponseHeaders': 3,
'scrapy-zyte-api/request_args/requestHeaders': 30,
'scrapy-zyte-api/request_args/sessionContext': 30,
'scrapy-zyte-api/request_args/url': 33,
'scrapy-zyte-api/status_codes/200': 33,
'scrapy-zyte-api/success': 33,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'spider_exceptions/ValueError': 1,
'start_time': datetime.datetime(2025, 12, 2, 10, 0, 20, 908118, tzinfo=datetime.timezone.utc)}
2025-12-02 10:04:48 [scrapy.core.engine] INFO: Spider closed (finished)