2025-12-05 20:00:08 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2025-12-05 20:00:08 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2025-12-05 20:00:08 [manheim.gb] INFO: Starting spider manheim.gb
2025-12-05 20:00:08 [scrapy.addons] INFO: Enabled addons:
[]
2025-12-05 20:00:08 [asyncio] DEBUG: Using selector: EpollSelector
2025-12-05 20:00:08 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2025-12-05 20:00:08 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2025-12-05 20:00:08 [scrapy.extensions.telnet] INFO: Telnet Password: c98821a9ea25aea9
2025-12-05 20:00:08 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2025-12-05 20:00:08 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/manheim.gb/task_37_2025-12-05T20_00_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2025-12-05 20:00:08 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-05 20:00:08 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-05 20:00:08 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2025-12-05 20:00:08 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2025-12-05 20:00:08 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2025-12-05 20:00:08 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2025-12-05 20:00:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:00:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:00:08 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2025-12-05 20:00:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2025-12-05 20:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:09 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2025-12-05 20:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2025-12-05 20:00:09 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2025-12-05 20:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2025-12-05 20:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2025-12-05 20:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2025-12-05 20:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2025-12-05 20:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2025-12-05 20:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2025-12-05 20:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2025-12-05 20:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2025-12-05 20:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2025-12-05 20:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2025-12-05 20:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2025-12-05 20:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2025-12-05 20:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2025-12-05 20:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2025-12-05 20:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2025-12-05 20:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2025-12-05 20:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2025-12-05 20:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2025-12-05 20:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2025-12-05 20:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2025-12-05 20:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2025-12-05 20:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2025-12-05 20:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2025-12-05 20:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2025-12-05 20:00:09 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2025-12-05 20:00:09 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2025-12-05 20:00:09 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2025-12-05 20:00:09 [scrapy.core.engine] INFO: Spider opened
2025-12-05 20:00:09 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-12-05 20:00:09 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2025-12-05 20:00:09 [scrapy-playwright] INFO: Starting download handler
2025-12-05 20:00:09 [scrapy-playwright] INFO: Starting download handler
2025-12-05 20:00:14 [scrapy-playwright] INFO: Launching browser firefox
2025-12-05 20:00:14 [scrapy-playwright] INFO: Browser firefox launched
2025-12-05 20:00:14 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2025-12-05 20:00:15 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2025-12-05 20:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/> (resource type: document)
2025-12-05 20:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://www.manheim.co.uk/>
2025-12-05 20:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/> (resource type: document)
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/>
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1> (resource type: stylesheet, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/bundles/delete/scripts/homepage?v=CIpuZXIp0V7i0j1sjTB9sUemSg9-D9w8k891UP0sReI1> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en>
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en>
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960>
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960>
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960>
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1>
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/core-blessed1.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/bundles/delete/scripts/homepage?v=CIpuZXIp0V7i0j1sjTB9sUemSg9-D9w8k891UP0sReI1>
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js>
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js>
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css>
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/core-blessed1.min.css>
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en>
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en>
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960>
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960>
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960>
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H>
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/filters/dot_pattern.png> (resource type: image, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png> (resource type: image, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/filters/dot_pattern.png>
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png>
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.manheim.co.uk/Account/IsCookieExist> (resource type: xhr, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/upload/homepageimage.ashx?la=en&mw=1920> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/upload/homepageimage.ashx?la=en&mw=1920>
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-8665-treated--hero.ashx?la=en&mw=1920> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-8665-treated--hero.ashx?la=en&mw=1920>
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff>
2025-12-05 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff>
2025-12-05 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff>
2025-12-05 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff>
2025-12-05 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Account/IsCookieExist>
2025-12-05 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-05 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/pd.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-05 20:00:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/pd.js>
2025-12-05 20:00:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/analytics?ver=3&visitor_id=&visitor_id_sign=&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/analytics?ver=3&visitor_id=&visitor_id_sign=&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=>
2025-12-05 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=919276837&visitor_id_sign=9d1ef93741cbc8623b39ddbf75ad4639df6410f59e62e0ea3540793c195a990aba8e13460bee7ce0f1aab23d573ba4fd413ff455&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=919276837&visitor_id_sign=9d1ef93741cbc8623b39ddbf75ad4639df6410f59e62e0ea3540793c195a990aba8e13460bee7ce0f1aab23d573ba4fd413ff455&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=>
2025-12-05 20:00:27 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.manheim.co.uk/account/login> (resource type: document, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:28 [scrapy-playwright] DEBUG: [Context=default] Response: <302 https://www.manheim.co.uk/account/login> (location: /mymanheim/dashboard)
2025-12-05 20:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/mymanheim/dashboard> (resource type: document, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/mymanheim/dashboard>
2025-12-05 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1> (resource type: stylesheet, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/bundles/delete/scripts/postlogin?v=Bwe963dGqUB3Sdny8E3tKSL2gV9GDgLwX1g6Gq6KF-A1> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/SignalR/Hubs> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en>
2025-12-05 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/jquery-ui-1.12.1.js> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Content/myManheim.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/bundles/simulcast?v=P7s0oLmuXc3p3WQNs8URnZ4NaK3K6qkWLOwf0uOs5gw1> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Content/dashboards.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en>
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1>
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1>
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en>
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en>
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en>
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en>
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en>
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en>
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1>
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/core-blessed1.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/bundles/delete/scripts/postlogin?v=Bwe963dGqUB3Sdny8E3tKSL2gV9GDgLwX1g6Gq6KF-A1>
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/SignalR/Hubs>
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Response: <302 https://www.manheim.co.uk/Scripts/jquery-ui-1.12.1.js> (location: https://www.manheim.co.uk/404)
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Content/myManheim.css>
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/bundles/simulcast?v=P7s0oLmuXc3p3WQNs8URnZ4NaK3K6qkWLOwf0uOs5gw1>
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/404> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Content/dashboards.css>
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js>
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js>
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css>
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/core-blessed1.min.css>
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Response: <404 https://www.manheim.co.uk/404>
2025-12-05 20:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en>
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en>
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1>
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1>
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en>
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en>
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en>
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en>
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en>
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en>
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png> (resource type: image, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png>
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H>
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/thickbox/loadingAnimation.gif> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/thickbox/loadingAnimation.gif>
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.manheim.co.uk/Account/IsCookieExist> (resource type: xhr, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff>
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff>
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff>
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff>
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Account/IsCookieExist>
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/pd.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/pd.js>
2025-12-05 20:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/analytics?ver=3&visitor_id=919276837&visitor_id_sign=9d1ef93741cbc8623b39ddbf75ad4639df6410f59e62e0ea3540793c195a990aba8e13460bee7ce0f1aab23d573ba4fd413ff455&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:33 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/analytics?ver=3&visitor_id=919276837&visitor_id_sign=9d1ef93741cbc8623b39ddbf75ad4639df6410f59e62e0ea3540793c195a990aba8e13460bee7ce0f1aab23d573ba4fd413ff455&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F>
2025-12-05 20:00:33 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=919276837&visitor_id_sign=9d1ef93741cbc8623b39ddbf75ad4639df6410f59e62e0ea3540793c195a990aba8e13460bee7ce0f1aab23d573ba4fd413ff455&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 20:00:33 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=919276837&visitor_id_sign=9d1ef93741cbc8623b39ddbf75ad4639df6410f59e62e0ea3540793c195a990aba8e13460bee7ce0f1aab23d573ba4fd413ff455&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F>
2025-12-05 20:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk> (referer: None) ['playwright']
2025-12-05 20:00:37 [manheim.gb] INFO: Cookies from Playwright: [{'name': 'ASP.NET_SessionId', 'value': 'if042tofxsngbdhe23wv21m1', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': -1, 'httpOnly': True, 'secure': True, 'sameSite': 'Lax'}, {'name': '__RequestVerificationToken', 'value': 'nU092292_fb36fY4YsOPXJRxmocLbgpbapQbWeasv0WD4-Ta0NcIaELbdYGjp2n_mJiZmtZWJDq7XHbiF6OlSy1z1rU1', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': -1, 'httpOnly': True, 'secure': True, 'sameSite': 'None'}, {'name': 'cb-enabled', 'value': 'enabled', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1796500817, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'remarketing-web', 'value': '01EE3EEF5881A3D06A095966BF16E891C15006DFAD3A8A6CD56FC462C7F46B81A38CD595557651354A4AC77763B1BF1E33893FE579579E9458C83AA4E9DD356207F227681CD280CB638FC6EFB6E7A3CD9C617496375A451EFD12BEF6D90022DE45239A334982DDD057217DDC4F2DD500BBEA0DAC', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': -1, 'httpOnly': True, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '919276837', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1796500833, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': '9d1ef93741cbc8623b39ddbf75ad4639df6410f59e62e0ea3540793c195a990aba8e13460bee7ce0f1aab23d573ba4fd413ff455', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1796500833, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '919276837', 'domain': 'brands.coxauto.co.uk', 'path': '/', 'expires': 1796500833, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': '9d1ef93741cbc8623b39ddbf75ad4639df6410f59e62e0ea3540793c195a990aba8e13460bee7ce0f1aab23d573ba4fd413ff455', 'domain': 'brands.coxauto.co.uk', 'path': '/', 'expires': 1796500833, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '919276837', 'domain': '.pardot.com', 'path': '/', 'expires': 1796500833, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': '9d1ef93741cbc8623b39ddbf75ad4639df6410f59e62e0ea3540793c195a990aba8e13460bee7ce0f1aab23d573ba4fd413ff455', 'domain': '.pardot.com', 'path': '/', 'expires': 1796500833, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'lpv37592', 'value': 'aHR0cHM6Ly93d3cubWFuaGVpbS5jby51ay9teW1hbmhlaW0vZGFzaGJvYXJk', 'domain': 'pi.pardot.com', 'path': '/', 'expires': 1764966633, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2025-12-05 20:00:37 [manheim.gb] INFO: Scrapy-formatted cookies: [{'name': 'ASP.NET_SessionId', 'value': 'if042tofxsngbdhe23wv21m1', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': '__RequestVerificationToken', 'value': 'nU092292_fb36fY4YsOPXJRxmocLbgpbapQbWeasv0WD4-Ta0NcIaELbdYGjp2n_mJiZmtZWJDq7XHbiF6OlSy1z1rU1', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'cb-enabled', 'value': 'enabled', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'remarketing-web', 'value': '01EE3EEF5881A3D06A095966BF16E891C15006DFAD3A8A6CD56FC462C7F46B81A38CD595557651354A4AC77763B1BF1E33893FE579579E9458C83AA4E9DD356207F227681CD280CB638FC6EFB6E7A3CD9C617496375A451EFD12BEF6D90022DE45239A334982DDD057217DDC4F2DD500BBEA0DAC', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '919276837', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': '9d1ef93741cbc8623b39ddbf75ad4639df6410f59e62e0ea3540793c195a990aba8e13460bee7ce0f1aab23d573ba4fd413ff455', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '919276837', 'domain': 'brands.coxauto.co.uk', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': '9d1ef93741cbc8623b39ddbf75ad4639df6410f59e62e0ea3540793c195a990aba8e13460bee7ce0f1aab23d573ba4fd413ff455', 'domain': 'brands.coxauto.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '919276837', 'domain': '.pardot.com', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': '9d1ef93741cbc8623b39ddbf75ad4639df6410f59e62e0ea3540793c195a990aba8e13460bee7ce0f1aab23d573ba4fd413ff455', 'domain': '.pardot.com', 'path': '/'}, {'name': 'lpv37592', 'value': 'aHR0cHM6Ly93d3cubWFuaGVpbS5jby51ay9teW1hbmhlaW0vZGFzaGJvYXJk', 'domain': 'pi.pardot.com', 'path': '/'}]
2025-12-05 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Manheim',RowKey='cookies') HTTP/1.1" 204 0
2025-12-05 20:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search) ['zyte-api']
2025-12-05 20:00:39 [manheim.gb] INFO: Found listing with ID: 1005857
2025-12-05 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271005857%27 HTTP/1.1" 200 None
2025-12-05 20:00:39 [manheim.gb] INFO: Scrape type for 1005857: 0
2025-12-05 20:00:39 [manheim.gb] INFO: Found listing with ID: 1095462
2025-12-05 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271095462%27 HTTP/1.1" 200 None
2025-12-05 20:00:39 [manheim.gb] INFO: Scrape type for 1095462: 0
2025-12-05 20:00:39 [manheim.gb] INFO: Found listing with ID: 1123228
2025-12-05 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271123228%27 HTTP/1.1" 200 None
2025-12-05 20:00:39 [manheim.gb] INFO: Scrape type for 1123228: 1
2025-12-05 20:00:39 [manheim.gb] INFO: Found listing with ID: 1127441
2025-12-05 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271127441%27 HTTP/1.1" 200 None
2025-12-05 20:00:39 [manheim.gb] INFO: Scrape type for 1127441: 0
2025-12-05 20:00:39 [manheim.gb] INFO: Found listing with ID: 1153610
2025-12-05 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271153610%27 HTTP/1.1" 200 None
2025-12-05 20:00:39 [manheim.gb] INFO: Scrape type for 1153610: 2
2025-12-05 20:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:39 [manheim.gb] INFO: Found listing with ID: 1164897
2025-12-05 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271164897%27 HTTP/1.1" 200 None
2025-12-05 20:00:39 [manheim.gb] INFO: Scrape type for 1164897: 1
2025-12-05 20:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:39 [manheim.gb] INFO: Found listing with ID: 1196641
2025-12-05 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271196641%27 HTTP/1.1" 200 None
2025-12-05 20:00:39 [manheim.gb] INFO: Scrape type for 1196641: 1
2025-12-05 20:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:39 [manheim.gb] INFO: Found listing with ID: 1249898
2025-12-05 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271249898%27 HTTP/1.1" 200 None
2025-12-05 20:00:39 [manheim.gb] INFO: Scrape type for 1249898: 0
2025-12-05 20:00:39 [manheim.gb] INFO: Found listing with ID: 1257174
2025-12-05 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271257174%27 HTTP/1.1" 200 None
2025-12-05 20:00:39 [manheim.gb] INFO: Scrape type for 1257174: 0
2025-12-05 20:00:39 [manheim.gb] INFO: Found listing with ID: 1271730
2025-12-05 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271271730%27 HTTP/1.1" 200 None
2025-12-05 20:00:39 [manheim.gb] INFO: Scrape type for 1271730: 0
2025-12-05 20:00:39 [manheim.gb] INFO: Found listing with ID: 1297328
2025-12-05 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271297328%27 HTTP/1.1" 200 None
2025-12-05 20:00:39 [manheim.gb] INFO: Scrape type for 1297328: 0
2025-12-05 20:00:39 [manheim.gb] INFO: Found listing with ID: 1318037
2025-12-05 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271318037%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1318037: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1319653
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271319653%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1319653: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1342103
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271342103%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1342103: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1396766
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271396766%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1396766: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1405448
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271405448%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1405448: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1409687
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271409687%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1409687: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1410764
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271410764%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1410764: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1418917
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271418917%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1418917: 2
2025-12-05 20:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1424731
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271424731%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1424731: 1
2025-12-05 20:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1430865
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271430865%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1430865: 2
2025-12-05 20:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1483148
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271483148%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1483148: 1
2025-12-05 20:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1490428
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271490428%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1490428: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1512515
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271512515%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1512515: 1
2025-12-05 20:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1535266
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271535266%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1535266: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1541191
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271541191%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1541191: 2
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1564179
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271564179%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1564179: 2
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1589816
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271589816%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1589816: 1
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1603150
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271603150%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1603150: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1611374
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271611374%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1611374: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1651594
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271651594%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1651594: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1678661
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271678661%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1678661: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1688155
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271688155%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1688155: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1708581
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271708581%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1708581: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1714274
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271714274%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1714274: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1727332
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271727332%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1727332: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1749068
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271749068%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1749068: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1753030
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271753030%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1753030: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1761741
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271761741%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1761741: 2
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1773610
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271773610%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1773610: 1
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1783769
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271783769%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1783769: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1852433
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271852433%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1852433: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1856565
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271856565%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1856565: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1877473
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271877473%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1877473: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1926821
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271926821%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1926821: 1
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1962040
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271962040%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1962040: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1966868
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271966868%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1966868: 2
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 1995165
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271995165%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 1995165: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 2022887
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272022887%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 2022887: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 2029104
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272029104%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 2029104: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 2057516
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272057516%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 2057516: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 2058572
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272058572%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 2058572: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 2063938
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272063938%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 2063938: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 2075642
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272075642%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 2075642: 2
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 2091777
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272091777%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 2091777: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 2093385
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272093385%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 2093385: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 21085
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%2721085%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 21085: 1
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 2133815
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272133815%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 2133815: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 2143943
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272143943%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 2143943: 2
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 2171364
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272171364%27 HTTP/1.1" 200 None
2025-12-05 20:00:40 [manheim.gb] INFO: Scrape type for 2171364: 0
2025-12-05 20:00:40 [manheim.gb] INFO: Found listing with ID: 2213009
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272213009%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [manheim.gb] INFO: Scrape type for 2213009: 0
2025-12-05 20:00:41 [manheim.gb] INFO: Found listing with ID: 2213672
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272213672%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [manheim.gb] INFO: Scrape type for 2213672: 0
2025-12-05 20:00:41 [manheim.gb] INFO: Found listing with ID: 2216514
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272216514%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [manheim.gb] INFO: Scrape type for 2216514: 0
2025-12-05 20:00:41 [manheim.gb] INFO: Found listing with ID: 2218237
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272218237%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [manheim.gb] INFO: Scrape type for 2218237: 1
2025-12-05 20:00:41 [manheim.gb] INFO: Found listing with ID: 2237239
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272237239%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [manheim.gb] INFO: Scrape type for 2237239: 0
2025-12-05 20:00:41 [manheim.gb] INFO: Found listing with ID: 2247450
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272247450%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [manheim.gb] INFO: Scrape type for 2247450: 2
2025-12-05 20:00:41 [manheim.gb] INFO: Found listing with ID: 2262431
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272262431%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [manheim.gb] INFO: Scrape type for 2262431: 0
2025-12-05 20:00:41 [manheim.gb] INFO: Found listing with ID: 2265358
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272265358%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [manheim.gb] INFO: Scrape type for 2265358: 2
2025-12-05 20:00:41 [manheim.gb] INFO: Found listing with ID: 2274146
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272274146%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [manheim.gb] INFO: Scrape type for 2274146: 0
2025-12-05 20:00:41 [manheim.gb] INFO: Found listing with ID: 2286249
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272286249%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [manheim.gb] INFO: Scrape type for 2286249: 0
2025-12-05 20:00:41 [manheim.gb] INFO: Found listing with ID: 2292492
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272292492%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [manheim.gb] INFO: Scrape type for 2292492: 0
2025-12-05 20:00:41 [manheim.gb] INFO: Found listing with ID: 2316345
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272316345%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [manheim.gb] INFO: Scrape type for 2316345: 0
2025-12-05 20:00:41 [manheim.gb] INFO: Found listing with ID: 233754
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27233754%27 HTTP/1.1" 200 None
2025-12-05 20:00:41 [manheim.gb] INFO: Scrape type for 233754: 2
2025-12-05 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/C4CACTUS?id=1153610&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231153610&indx=8> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f47d01f0-feb9-5a54-bd44-6fbcc752274f with identifier: 1153610
2025-12-05 20:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f47d01f0-feb9-5a54-bd44-6fbcc752274f with scrape type 2
2025-12-05 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f47d01f0-feb9-5a54-bd44-6fbcc752274f with scrape type 2
2025-12-05 20:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f47d01f0-feb9-5a54-bd44-6fbcc752274f, identifier: 1153610
2025-12-05 20:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f47d01f0-feb9-5a54-bd44-6fbcc752274f with identifier: 1153610
2025-12-05 20:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:01:05 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=WHITE HTTP/1.1" 200 None
2025-12-05 20:01:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:01:05 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol HTTP/1.1" 200 None
2025-12-05 20:01:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f47d01f0-feb9-5a54-bd44-6fbcc752274f with identifier: 1153610
2025-12-05 20:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f47d01f0-feb9-5a54-bd44-6fbcc752274f with identifier: 1153610 to the API
2025-12-05 20:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/CITROEN/C4CACTUS?id=1153610&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231153610&indx=8>
{'auction_title': '',
'c_o_2_emission_value': 107,
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001153610-01979357-004.pdf',
'color': 'WHITE',
'currency': 'GBP',
'engine': '1.2L',
'expiration_date': '2025-12-11T09:00:00Z',
'fuel_type': 'Petrol',
'id': 'f47d01f0-feb9-5a54-bd44-6fbcc752274f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YW65FVD',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C4%20CACTUS?id=1153610',
'listing': 'auction',
'location': 'Colchester',
'make': 'CITROEN',
'model': 'C4 CACTUS',
'odometer': 67906,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-05',
'seller_name': 'John Banks',
'title': 'CITROEN C4 CACTUS 1.2 PureTech [82] Flair 5dr',
'transmission': 'manual',
'trim': '1.2 PureTech [82] Flair 5dr',
'year': 2016}
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271153610%27 HTTP/1.1" 200 None
2025-12-05 20:01:06 [manheim.gb] INFO: Saving data for 1153610: {'auction_closing_time': 1765443600.0, 'created_time': 1764014993.216472, 'last_price_update_time': 1764964866.052414}
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1153610') HTTP/1.1" 204 0
2025-12-05 20:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/208?id=1123228&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231123228&indx=6> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 527bd38b-bb30-52cf-b049-0cd34e2be0bf with identifier: 1123228
2025-12-05 20:01:06 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 527bd38b-bb30-52cf-b049-0cd34e2be0bf
2025-12-05 20:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/MONDEO?id=1483148&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231483148&indx=30> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34b9ed7f-19f8-5791-bced-0a85f823689a with identifier: 1483148
2025-12-05 20:01:08 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 34b9ed7f-19f8-5791-bced-0a85f823689a
2025-12-05 20:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001123228-01987612-002.pdf> (referer: None)
2025-12-05 20:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc641da210>
2025-12-05 20:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_expert_report_file_7cdbab08-2b10-42a9-a46b-60fc28112b7e.pdf HTTP/1.1" 201 0
2025-12-05 20:01:09 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 527bd38b-bb30-52cf-b049-0cd34e2be0bf
2025-12-05 20:01:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 527bd38b-bb30-52cf-b049-0cd34e2be0bf, skipping ID generation
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 527bd38b-bb30-52cf-b049-0cd34e2be0bf
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_7.jpg not downloaded yet
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_7.jpg not downloaded yet
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_6.jpg not downloaded yet
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_1.jpg not downloaded yet
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3d4a2641-8871-481a-9f78-5fdbfd95a0d9_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_5.jpg not downloaded yet
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3d4a2641-8871-481a-9f78-5fdbfd95a0d9_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_4.jpg not downloaded yet
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3d4a2641-8871-481a-9f78-5fdbfd95a0d9_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_11.jpg not downloaded yet
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3d4a2641-8871-481a-9f78-5fdbfd95a0d9_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_10.jpg not downloaded yet
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3d4a2641-8871-481a-9f78-5fdbfd95a0d9_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_9.jpg not downloaded yet
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_2.jpg not downloaded yet
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_5.jpg not downloaded yet
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_3.jpg not downloaded yet
2025-12-05 20:01:09 [scrapy.extensions.logstats] INFO: Crawled 6 pages (at 6 pages/min), scraped 1 items (at 1 items/min)
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_4.jpg not downloaded yet
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1123228-4009786-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-13.jpg not downloaded yet
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1123228-4009786-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1000.jpg not downloaded yet
2025-12-05 20:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001483148-01992942-002.pdf> (referer: None)
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1123228-4009786-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1001.jpg not downloaded yet
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1123228-4009786-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1002.jpg not downloaded yet
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1123228-4009786-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1003.jpg not downloaded yet
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1123228-4009786-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1004.jpg not downloaded yet
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1123228-4009786-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1005.jpg not downloaded yet
2025-12-05 20:01:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc645ac190>
2025-12-05 20:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_expert_report_file_860f6c47-5cb1-4dc8-b183-cb0fa990d081.pdf HTTP/1.1" 201 0
2025-12-05 20:01:09 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 34b9ed7f-19f8-5791-bced-0a85f823689a
2025-12-05 20:01:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 34b9ed7f-19f8-5791-bced-0a85f823689a, skipping ID generation
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 34b9ed7f-19f8-5791-bced-0a85f823689a
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F05fff5d2-8914-42ff-a630-293c2aec363d_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_7.jpg not downloaded yet
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F05fff5d2-8914-42ff-a630-293c2aec363d_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_7.jpg not downloaded yet
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F05fff5d2-8914-42ff-a630-293c2aec363d_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_6.jpg not downloaded yet
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F05fff5d2-8914-42ff-a630-293c2aec363d_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_1.jpg not downloaded yet
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F05fff5d2-8914-42ff-a630-293c2aec363d_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_5.jpg not downloaded yet
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F05fff5d2-8914-42ff-a630-293c2aec363d_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_4.jpg not downloaded yet
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F05fff5d2-8914-42ff-a630-293c2aec363d_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_11.jpg not downloaded yet
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F05fff5d2-8914-42ff-a630-293c2aec363d_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_10.jpg not downloaded yet
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F05fff5d2-8914-42ff-a630-293c2aec363d_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_9.jpg not downloaded yet
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F05fff5d2-8914-42ff-a630-293c2aec363d_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_2.jpg not downloaded yet
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F05fff5d2-8914-42ff-a630-293c2aec363d_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_5.jpg not downloaded yet
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F05fff5d2-8914-42ff-a630-293c2aec363d_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_3.jpg not downloaded yet
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F05fff5d2-8914-42ff-a630-293c2aec363d_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_4.jpg not downloaded yet
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1483148-4009544-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-13.jpg not downloaded yet
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1483148-4009544-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1000.jpg not downloaded yet
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1483148-4009544-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1001.jpg not downloaded yet
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1483148-4009544-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1002.jpg not downloaded yet
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1483148-4009544-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1003.jpg not downloaded yet
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1483148-4009544-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1004.jpg not downloaded yet
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1483148-4009544-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1005.jpg not downloaded yet
2025-12-05 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001123228-01987612-002.pdf)
2025-12-05 20:01:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fb86550>
2025-12-05 20:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_19.jpg HTTP/1.1" 201 0
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1123228-4009786-1005.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1005.jpg saved to cache
2025-12-05 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 527bd38b-bb30-52cf-b049-0cd34e2be0bf
2025-12-05 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/BMW/X5?id=1430865&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231430865&indx=28> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001483148-01992942-002.pdf)
2025-12-05 20:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84d8ee3d-560c-5393-b556-6a347ebcff2a with identifier: 1430865
2025-12-05 20:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84d8ee3d-560c-5393-b556-6a347ebcff2a with scrape type 2
2025-12-05 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84d8ee3d-560c-5393-b556-6a347ebcff2a with scrape type 2
2025-12-05 20:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 84d8ee3d-560c-5393-b556-6a347ebcff2a, identifier: 1430865
2025-12-05 20:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 84d8ee3d-560c-5393-b556-6a347ebcff2a with identifier: 1430865
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:01:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLACK HTTP/1.1" 200 None
2025-12-05 20:01:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel HTTP/1.1" 200 None
2025-12-05 20:01:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 84d8ee3d-560c-5393-b556-6a347ebcff2a with identifier: 1430865
2025-12-05 20:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
2025-12-05 20:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 84d8ee3d-560c-5393-b556-6a347ebcff2a spider: manheim.gb
2025-12-05 20:01:11 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 84d8ee3d-560c-5393-b556-6a347ebcff2a due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
{'auction_title': '',
'c_o_2_emission_value': 158,
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001430865-01986166-003.pdf',
'color': 'BLACK',
'currency': 'GBP',
'engine': '3.0L',
'expiration_date': '2025-12-08T09:00:00Z',
'fuel_type': 'Diesel',
'id': '84d8ee3d-560c-5393-b556-6a347ebcff2a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LG65HYT',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/BMW/X5?id=1430865',
'listing': 'auction',
'location': 'Leeds',
'make': 'BMW',
'model': 'X5',
'odometer': 81094,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-07',
'seller_name': 'Lookers',
'title': 'BMW X5 xDrive30d M Sport 5dr Auto [7 Seat]',
'transmission': 'automatic',
'trim': 'xDrive30d M Sport 5dr Auto [7 Seat]',
'year': 2015}
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271430865%27 HTTP/1.1" 200 None
2025-12-05 20:01:11 [manheim.gb] INFO: Saving data for 1430865: {'auction_closing_time': 1765184400.0, 'created_time': 1764842513.268707, 'last_price_update_time': 1764964871.998191}
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1430865') HTTP/1.1" 204 0
2025-12-05 20:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/CCLASS?id=1164897&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231164897&indx=9> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fbf6510>
2025-12-05 20:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_19.jpg HTTP/1.1" 201 0
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1483148-4009544-1005.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1005.jpg saved to cache
2025-12-05 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 34b9ed7f-19f8-5791-bced-0a85f823689a
2025-12-05 20:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001483148-01992942-002.pdf)
2025-12-05 20:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: feb141fb-ed11-587f-b5b8-efa878ee240c with identifier: 1164897
2025-12-05 20:01:12 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item feb141fb-ed11-587f-b5b8-efa878ee240c
2025-12-05 20:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001483148-01992942-002.pdf)
2025-12-05 20:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f23da90>
2025-12-05 20:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_17.jpg HTTP/1.1" 201 0
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1483148-4009544-1003.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1003.jpg saved to cache
2025-12-05 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 34b9ed7f-19f8-5791-bced-0a85f823689a
2025-12-05 20:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001483148-01992942-002.pdf)
2025-12-05 20:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fbade90>
2025-12-05 20:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_18.jpg HTTP/1.1" 201 0
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1483148-4009544-1004.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1004.jpg saved to cache
2025-12-05 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 34b9ed7f-19f8-5791-bced-0a85f823689a
2025-12-05 20:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640f30d0>
2025-12-05 20:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_16.jpg HTTP/1.1" 201 0
2025-12-05 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1483148-4009544-1002.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1002.jpg saved to cache
2025-12-05 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 34b9ed7f-19f8-5791-bced-0a85f823689a
2025-12-05 20:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001483148-01992942-002.pdf)
2025-12-05 20:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001483148-01992942-002.pdf)
2025-12-05 20:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001164897-01992879-001.pdf> (referer: None)
2025-12-05 20:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc645e7c10>
2025-12-05 20:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_15.jpg HTTP/1.1" 201 0
2025-12-05 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1483148-4009544-1001.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1001.jpg saved to cache
2025-12-05 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 34b9ed7f-19f8-5791-bced-0a85f823689a
2025-12-05 20:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc646279d0>
2025-12-05 20:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1483148-4009544-1000.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1000.jpg saved to cache
2025-12-05 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 34b9ed7f-19f8-5791-bced-0a85f823689a
2025-12-05 20:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2aa310>
2025-12-05 20:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_expert_report_file_dfc5444b-0e50-4a14-9450-fe513fbbfd45.pdf HTTP/1.1" 201 0
2025-12-05 20:01:14 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item feb141fb-ed11-587f-b5b8-efa878ee240c
2025-12-05 20:01:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: feb141fb-ed11-587f-b5b8-efa878ee240c, skipping ID generation
2025-12-05 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item feb141fb-ed11-587f-b5b8-efa878ee240c
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_7.jpg not downloaded yet
2025-12-05 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001483148-01992942-002.pdf)
2025-12-05 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001483148-01992942-002.pdf)
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_7.jpg not downloaded yet
2025-12-05 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001483148-01992942-002.pdf)
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_6.jpg not downloaded yet
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_1.jpg not downloaded yet
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd72420e9-3f2c-4b53-a506-45b3ab6e4fde_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_5.jpg not downloaded yet
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd72420e9-3f2c-4b53-a506-45b3ab6e4fde_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_4.jpg not downloaded yet
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd72420e9-3f2c-4b53-a506-45b3ab6e4fde_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_11.jpg not downloaded yet
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd72420e9-3f2c-4b53-a506-45b3ab6e4fde_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_10.jpg not downloaded yet
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc645f9c90>
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F05fff5d2-8914-42ff-a630-293c2aec363d_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_4.jpg saved to cache
2025-12-05 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 34b9ed7f-19f8-5791-bced-0a85f823689a
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2f1550>
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F05fff5d2-8914-42ff-a630-293c2aec363d_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_3.jpg saved to cache
2025-12-05 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 34b9ed7f-19f8-5791-bced-0a85f823689a
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd72420e9-3f2c-4b53-a506-45b3ab6e4fde_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_9.jpg not downloaded yet
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2d7590>
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1483148-4009544-13.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-13.jpg saved to cache
2025-12-05 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 34b9ed7f-19f8-5791-bced-0a85f823689a
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_2.jpg not downloaded yet
2025-12-05 20:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/KIA/PICANTO?id=1196641&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231196641&indx=11> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_5.jpg not downloaded yet
2025-12-05 20:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_3.jpg not downloaded yet
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_4.jpg not downloaded yet
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1164897-4010084-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1164897-4010084-13.jpg not downloaded yet
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1164897-4010084-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1164897-4010084-1000.jpg not downloaded yet
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1164897-4010084-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1164897-4010084-1001.jpg not downloaded yet
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1164897-4010084-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1164897-4010084-1002.jpg not downloaded yet
2025-12-05 20:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b77bcaaf-cd63-5637-b64e-726bcda6367c with identifier: 1196641
2025-12-05 20:01:15 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b77bcaaf-cd63-5637-b64e-726bcda6367c
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1164897-4010084-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1164897-4010084-1003.jpg not downloaded yet
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1164897-4010084-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1164897-4010084-1004.jpg not downloaded yet
2025-12-05 20:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=1418917&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231418917&indx=26> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1164897-4010084-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1164897-4010084-1005.jpg not downloaded yet
2025-12-05 20:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001164897-01992879-001.pdf)
2025-12-05 20:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001164897-01992879-001.pdf)
2025-12-05 20:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001164897-01992879-001.pdf)
2025-12-05 20:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d313d20e-3e85-5824-9c26-e84f724785c6 with identifier: 1418917
2025-12-05 20:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d313d20e-3e85-5824-9c26-e84f724785c6 with scrape type 2
2025-12-05 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d313d20e-3e85-5824-9c26-e84f724785c6 with scrape type 2
2025-12-05 20:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: d313d20e-3e85-5824-9c26-e84f724785c6, identifier: 1418917
2025-12-05 20:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: d313d20e-3e85-5824-9c26-e84f724785c6 with identifier: 1418917
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GREY HTTP/1.1" 200 None
2025-12-05 20:01:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: d313d20e-3e85-5824-9c26-e84f724785c6 with identifier: 1418917
2025-12-05 20:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 157446 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
157446
2025-12-05 20:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d313d20e-3e85-5824-9c26-e84f724785c6 spider: manheim.gb
2025-12-05 20:01:15 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: d313d20e-3e85-5824-9c26-e84f724785c6 due to rule: high_mileage_for_country.json, error: 157446 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
157446
{'auction_title': '',
'c_o_2_emission_value': 98,
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001418917-01981846-004.pdf',
'color': 'GREY',
'currency': 'GBP',
'engine': '1.5L',
'expiration_date': '2025-12-09T09:00:00Z',
'fuel_type': 'Diesel',
'id': 'd313d20e-3e85-5824-9c26-e84f724785c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YR65OOF',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=1418917',
'listing': 'auction',
'location': 'Shotts',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 97833,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-30',
'seller_name': None,
'title': 'FORD FOCUS 1.5 TDCi 120 Titanium 5dr',
'transmission': 'manual',
'trim': '1.5 TDCi 120 Titanium 5dr',
'year': 2015}
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271418917%27 HTTP/1.1" 200 None
2025-12-05 20:01:15 [manheim.gb] INFO: Saving data for 1418917: {'auction_closing_time': 1765270800.0, 'created_time': 1764584221.653834, 'last_price_update_time': 1764964875.990475}
2025-12-05 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1418917') HTTP/1.1" 204 0
2025-12-05 20:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001164897-01992879-001.pdf)
2025-12-05 20:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e51c690>
2025-12-05 20:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd72420e9-3f2c-4b53-a506-45b3ab6e4fde_10.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_10.jpg saved to cache
2025-12-05 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item feb141fb-ed11-587f-b5b8-efa878ee240c
2025-12-05 20:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e528110>
2025-12-05 20:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd72420e9-3f2c-4b53-a506-45b3ab6e4fde_11.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_11.jpg saved to cache
2025-12-05 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item feb141fb-ed11-587f-b5b8-efa878ee240c
2025-12-05 20:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e51bfd0>
2025-12-05 20:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd72420e9-3f2c-4b53-a506-45b3ab6e4fde_9.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_9.jpg saved to cache
2025-12-05 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item feb141fb-ed11-587f-b5b8-efa878ee240c
2025-12-05 20:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1164897-4010084-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001164897-01992879-001.pdf)
2025-12-05 20:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1164897-4010084-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001164897-01992879-001.pdf)
2025-12-05 20:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1164897-4010084-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001164897-01992879-001.pdf)
2025-12-05 20:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fb81110>
2025-12-05 20:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_2.jpg saved to cache
2025-12-05 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item feb141fb-ed11-587f-b5b8-efa878ee240c
2025-12-05 20:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/AUDI/A6?id=1424731&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231424731&indx=27> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e4fb110>
2025-12-05 20:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_19.jpg HTTP/1.1" 201 0
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1164897-4010084-1005.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1164897-4010084-1005.jpg saved to cache
2025-12-05 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item feb141fb-ed11-587f-b5b8-efa878ee240c
2025-12-05 20:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc645446d0>
2025-12-05 20:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_17.jpg HTTP/1.1" 201 0
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1164897-4010084-1003.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1164897-4010084-1003.jpg saved to cache
2025-12-05 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item feb141fb-ed11-587f-b5b8-efa878ee240c
2025-12-05 20:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e4f9810>
2025-12-05 20:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_18.jpg HTTP/1.1" 201 0
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1164897-4010084-1004.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1164897-4010084-1004.jpg saved to cache
2025-12-05 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item feb141fb-ed11-587f-b5b8-efa878ee240c
2025-12-05 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1164897-4010084-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001164897-01992879-001.pdf)
2025-12-05 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1164897-4010084-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001164897-01992879-001.pdf)
2025-12-05 20:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8421b284-257e-5d29-9825-a3e2a3338a43 with identifier: 1424731
2025-12-05 20:01:18 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8421b284-257e-5d29-9825-a3e2a3338a43
2025-12-05 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1164897-4010084-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001164897-01992879-001.pdf)
2025-12-05 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1164897-4010084-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001164897-01992879-001.pdf)
2025-12-05 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001196641-01989766-005.pdf> (referer: None)
2025-12-05 20:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e4ffed0>
2025-12-05 20:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_16.jpg HTTP/1.1" 201 0
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1164897-4010084-1002.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1164897-4010084-1002.jpg saved to cache
2025-12-05 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item feb141fb-ed11-587f-b5b8-efa878ee240c
2025-12-05 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001164897-01992879-001.pdf)
2025-12-05 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001164897-01992879-001.pdf)
2025-12-05 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001164897-01992879-001.pdf)
2025-12-05 20:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64228990>
2025-12-05 20:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_15.jpg HTTP/1.1" 201 0
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1164897-4010084-1001.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1164897-4010084-1001.jpg saved to cache
2025-12-05 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item feb141fb-ed11-587f-b5b8-efa878ee240c
2025-12-05 20:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6406d090>
2025-12-05 20:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1164897-4010084-13.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1164897-4010084-13.jpg saved to cache
2025-12-05 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item feb141fb-ed11-587f-b5b8-efa878ee240c
2025-12-05 20:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6420e490>
2025-12-05 20:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1164897-4010084-1000.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1164897-4010084-1000.jpg saved to cache
2025-12-05 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item feb141fb-ed11-587f-b5b8-efa878ee240c
2025-12-05 20:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc642e5710>
2025-12-05 20:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_expert_report_file_3f30a6eb-1ac4-46fb-9124-526f095d172a.pdf HTTP/1.1" 201 0
2025-12-05 20:01:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b77bcaaf-cd63-5637-b64e-726bcda6367c
2025-12-05 20:01:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b77bcaaf-cd63-5637-b64e-726bcda6367c, skipping ID generation
2025-12-05 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item b77bcaaf-cd63-5637-b64e-726bcda6367c
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_7.jpg not downloaded yet
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_7.jpg not downloaded yet
2025-12-05 20:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001164897-01992879-001.pdf)
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_6.jpg not downloaded yet
2025-12-05 20:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2d7190>
2025-12-05 20:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd72420e9-3f2c-4b53-a506-45b3ab6e4fde_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_4.jpg saved to cache
2025-12-05 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item feb141fb-ed11-587f-b5b8-efa878ee240c
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc641edb10>
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_4.jpg saved to cache
2025-12-05 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item feb141fb-ed11-587f-b5b8-efa878ee240c
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f233210>
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_3.jpg saved to cache
2025-12-05 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item feb141fb-ed11-587f-b5b8-efa878ee240c
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_1.jpg not downloaded yet
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_5.jpg not downloaded yet
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2ef810>
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_5.jpg saved to cache
2025-12-05 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item feb141fb-ed11-587f-b5b8-efa878ee240c
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_4.jpg not downloaded yet
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_11.jpg not downloaded yet
2025-12-05 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001164897-01992879-001.pdf)
2025-12-05 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001196641-01989766-005.pdf)
2025-12-05 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001196641-01989766-005.pdf)
2025-12-05 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001196641-01989766-005.pdf)
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_10.jpg not downloaded yet
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_9.jpg not downloaded yet
2025-12-05 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001164897-01992879-001.pdf)
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_2.jpg not downloaded yet
2025-12-05 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_5.jpg not downloaded yet
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64336490>
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_1.jpg saved to cache
2025-12-05 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item feb141fb-ed11-587f-b5b8-efa878ee240c
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6431c390>
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_7.jpg saved to cache
2025-12-05 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b77bcaaf-cd63-5637-b64e-726bcda6367c
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc643285d0>
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_6.jpg saved to cache
2025-12-05 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b77bcaaf-cd63-5637-b64e-726bcda6367c
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc642912d0>
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_7.jpg saved to cache
2025-12-05 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b77bcaaf-cd63-5637-b64e-726bcda6367c
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6425a0d0>
2025-12-05 20:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd72420e9-3f2c-4b53-a506-45b3ab6e4fde_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_5.jpg saved to cache
2025-12-05 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item feb141fb-ed11-587f-b5b8-efa878ee240c
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_3.jpg not downloaded yet
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_4.jpg not downloaded yet
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1196641-4009708-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1196641-4009708-13.jpg not downloaded yet
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1196641-4009708-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1196641-4009708-1000.jpg not downloaded yet
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1196641-4009708-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1196641-4009708-1001.jpg not downloaded yet
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1196641-4009708-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1196641-4009708-1002.jpg not downloaded yet
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1196641-4009708-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1196641-4009708-1003.jpg not downloaded yet
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1196641-4009708-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1196641-4009708-1004.jpg not downloaded yet
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1196641-4009708-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1196641-4009708-1005.jpg not downloaded yet
2025-12-05 20:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001196641-01989766-005.pdf)
2025-12-05 20:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001196641-01989766-005.pdf)
2025-12-05 20:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001424731-01989538-002.pdf> (referer: None)
2025-12-05 20:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001196641-01989766-005.pdf)
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6419efd0>
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_9.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_9.jpg saved to cache
2025-12-05 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b77bcaaf-cd63-5637-b64e-726bcda6367c
2025-12-05 20:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001196641-01989766-005.pdf)
2025-12-05 20:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001196641-01989766-005.pdf)
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e518110>
2025-12-05 20:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_2.jpg saved to cache
2025-12-05 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b77bcaaf-cd63-5637-b64e-726bcda6367c
2025-12-05 20:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640e09d0>
2025-12-05 20:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_expert_report_file_938d9412-663c-4b73-b0c6-5bdf8be9337e.pdf HTTP/1.1" 201 0
2025-12-05 20:01:23 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8421b284-257e-5d29-9825-a3e2a3338a43
2025-12-05 20:01:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8421b284-257e-5d29-9825-a3e2a3338a43, skipping ID generation
2025-12-05 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 8421b284-257e-5d29-9825-a3e2a3338a43
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_7.jpg not downloaded yet
2025-12-05 20:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2d6bd0>
2025-12-05 20:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_3.jpg saved to cache
2025-12-05 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item b77bcaaf-cd63-5637-b64e-726bcda6367c
2025-12-05 20:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1196641-4009708-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001196641-01989766-005.pdf)
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_7.jpg not downloaded yet
2025-12-05 20:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1196641-4009708-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001196641-01989766-005.pdf)
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_6.jpg not downloaded yet
2025-12-05 20:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640d9e50>
2025-12-05 20:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_5.jpg saved to cache
2025-12-05 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item b77bcaaf-cd63-5637-b64e-726bcda6367c
2025-12-05 20:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6428a8d0>
2025-12-05 20:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_10.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_10.jpg saved to cache
2025-12-05 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b77bcaaf-cd63-5637-b64e-726bcda6367c
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_1.jpg not downloaded yet
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69b0539e-5cfa-4f3f-ba68-01c7664685a0_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_5.jpg not downloaded yet
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69b0539e-5cfa-4f3f-ba68-01c7664685a0_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_4.jpg not downloaded yet
2025-12-05 20:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64219b50>
2025-12-05 20:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_19.jpg HTTP/1.1" 201 0
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1196641-4009708-1005.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1196641-4009708-1005.jpg saved to cache
2025-12-05 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item b77bcaaf-cd63-5637-b64e-726bcda6367c
2025-12-05 20:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2f2f50>
2025-12-05 20:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_18.jpg HTTP/1.1" 201 0
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1196641-4009708-1004.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1196641-4009708-1004.jpg saved to cache
2025-12-05 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item b77bcaaf-cd63-5637-b64e-726bcda6367c
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69b0539e-5cfa-4f3f-ba68-01c7664685a0_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_11.jpg not downloaded yet
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69b0539e-5cfa-4f3f-ba68-01c7664685a0_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_10.jpg not downloaded yet
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69b0539e-5cfa-4f3f-ba68-01c7664685a0_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_9.jpg not downloaded yet
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_2.jpg not downloaded yet
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_5.jpg not downloaded yet
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_3.jpg not downloaded yet
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_4.jpg not downloaded yet
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1424731-4009638-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-13.jpg not downloaded yet
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1424731-4009638-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1000.jpg not downloaded yet
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1424731-4009638-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1001.jpg not downloaded yet
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1424731-4009638-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1002.jpg not downloaded yet
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1424731-4009638-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1003.jpg not downloaded yet
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1424731-4009638-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1004.jpg not downloaded yet
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1424731-4009638-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1005.jpg not downloaded yet
2025-12-05 20:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001424731-01989538-002.pdf)
2025-12-05 20:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001424731-01989538-002.pdf)
2025-12-05 20:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001424731-01989538-002.pdf)
2025-12-05 20:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2f1f50>
2025-12-05 20:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_16.jpg HTTP/1.1" 201 0
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1424731-4009638-1002.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1002.jpg saved to cache
2025-12-05 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 8421b284-257e-5d29-9825-a3e2a3338a43
2025-12-05 20:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001424731-01989538-002.pdf)
2025-12-05 20:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001424731-01989538-002.pdf)
2025-12-05 20:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640c0f10>
2025-12-05 20:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_19.jpg HTTP/1.1" 201 0
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1424731-4009638-1005.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1005.jpg saved to cache
2025-12-05 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 8421b284-257e-5d29-9825-a3e2a3338a43
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640d05d0>
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_15.jpg HTTP/1.1" 201 0
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1424731-4009638-1001.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1001.jpg saved to cache
2025-12-05 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 8421b284-257e-5d29-9825-a3e2a3338a43
2025-12-05 20:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001424731-01989538-002.pdf)
2025-12-05 20:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001424731-01989538-002.pdf)
2025-12-05 20:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001424731-01989538-002.pdf)
2025-12-05 20:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001424731-01989538-002.pdf)
2025-12-05 20:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001424731-01989538-002.pdf)
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fba3f10>
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_17.jpg HTTP/1.1" 201 0
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1424731-4009638-1003.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1003.jpg saved to cache
2025-12-05 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 8421b284-257e-5d29-9825-a3e2a3338a43
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f232210>
2025-12-05 20:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_4.jpg saved to cache
2025-12-05 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8421b284-257e-5d29-9825-a3e2a3338a43
2025-12-05 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001424731-01989538-002.pdf)
2025-12-05 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001424731-01989538-002.pdf)
2025-12-05 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001424731-01989538-002.pdf)
2025-12-05 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001424731-01989538-002.pdf)
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6430fe90>
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_3.jpg saved to cache
2025-12-05 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8421b284-257e-5d29-9825-a3e2a3338a43
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64411750>
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1424731-4009638-13.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-13.jpg saved to cache
2025-12-05 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8421b284-257e-5d29-9825-a3e2a3338a43
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc642645d0>
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_18.jpg HTTP/1.1" 201 0
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1424731-4009638-1004.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1004.jpg saved to cache
2025-12-05 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 8421b284-257e-5d29-9825-a3e2a3338a43
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc643dc490>
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1424731-4009638-1000.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1000.jpg saved to cache
2025-12-05 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8421b284-257e-5d29-9825-a3e2a3338a43
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc643c13d0>
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_5.jpg saved to cache
2025-12-05 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8421b284-257e-5d29-9825-a3e2a3338a43
2025-12-05 20:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001424731-01989538-002.pdf)
2025-12-05 20:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001424731-01989538-002.pdf)
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64305390>
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_2.jpg saved to cache
2025-12-05 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8421b284-257e-5d29-9825-a3e2a3338a43
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc642d4d50>
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69b0539e-5cfa-4f3f-ba68-01c7664685a0_9.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_9.jpg saved to cache
2025-12-05 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8421b284-257e-5d29-9825-a3e2a3338a43
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6422a590>
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69b0539e-5cfa-4f3f-ba68-01c7664685a0_10.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_10.jpg saved to cache
2025-12-05 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8421b284-257e-5d29-9825-a3e2a3338a43
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640f2210>
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69b0539e-5cfa-4f3f-ba68-01c7664685a0_11.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_11.jpg saved to cache
2025-12-05 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8421b284-257e-5d29-9825-a3e2a3338a43
2025-12-05 20:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001424731-01989538-002.pdf)
2025-12-05 20:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001424731-01989538-002.pdf)
2025-12-05 20:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001424731-01989538-002.pdf)
2025-12-05 20:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001424731-01989538-002.pdf)
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc641eeb10>
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69b0539e-5cfa-4f3f-ba68-01c7664685a0_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_5.jpg saved to cache
2025-12-05 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8421b284-257e-5d29-9825-a3e2a3338a43
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6418ca10>
2025-12-05 20:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69b0539e-5cfa-4f3f-ba68-01c7664685a0_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_4.jpg saved to cache
2025-12-05 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8421b284-257e-5d29-9825-a3e2a3338a43
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc642c9150>
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_7.jpg saved to cache
2025-12-05 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8421b284-257e-5d29-9825-a3e2a3338a43
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2aae50>
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_7.jpg saved to cache
2025-12-05 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8421b284-257e-5d29-9825-a3e2a3338a43
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e50e3d0>
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_1.jpg saved to cache
2025-12-05 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8421b284-257e-5d29-9825-a3e2a3338a43
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc641c3550>
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_6.jpg saved to cache
2025-12-05 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8421b284-257e-5d29-9825-a3e2a3338a43
2025-12-05 20:01:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8421b284-257e-5d29-9825-a3e2a3338a43, skipping ID generation
2025-12-05 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8421b284-257e-5d29-9825-a3e2a3338a43 from tracking dictionaries
2025-12-05 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8421b284-257e-5d29-9825-a3e2a3338a43 sending to next pipeline
2025-12-05 20:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 8421b284-257e-5d29-9825-a3e2a3338a43, identifier: 1424731
2025-12-05 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1196641-4009708-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001196641-01989766-005.pdf)
2025-12-05 20:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 8421b284-257e-5d29-9825-a3e2a3338a43 with identifier: 1424731
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Black HTTP/1.1" 200 None
2025-12-05 20:01:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 8421b284-257e-5d29-9825-a3e2a3338a43 with identifier: 1424731
2025-12-05 20:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 50, 'seller_name': 'harwoods group', 'price_includes_vat': False, 'title': 'audi a6 2.0 tdi ultra s line 4dr s tronic', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'a6', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 215060, 'odometer_reading_unit': 'mi', 'registration_date': '2015-01-30', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/audi/a6?id=1424731', 'location': 'colchester', 'origin_country_code': 'gb', 'trim': '2.0 tdi ultra s line 4dr s tronic', 'license_plate': 'fv64aeu', 'year': 2015, 'listing': 'auction', 'c_o_2_emission_value': 114, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001424731-01989538-002.pdf', 'expiration_date': '2025-12-11t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '8421b284-257e-5d29-9825-a3e2a3338a43', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_expert_report_file_938d9412-663c-4b73-b0c6-5bdf8be9337e.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 154728}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 154728}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 199260}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 153407}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_5.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 149462}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_4.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 154403}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_11.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 154256}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_10.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 149006}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_9.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 151031}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 189719}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 254555}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 269061}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 241674}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 338950}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 275937}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 272613}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 395465}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 386281}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 433437}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 351741}], 'current_year_diff': 10, 'age_in_months': 130, 'make_model': 'audi a6', 'sanitized_make': 'audi', 'odometer_in_km': 346104}
Failed validating None in schema:
False
On instance:
{'age_in_months': 130,
'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_expert_report_file_938d9412-663c-4b73-b0c6-5bdf8be9337e.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001424731-01989538-002.pdf',
'color': 'black',
'currency': 'gbp',
'current_year_diff': 10,
'engine': '2.0l',
'expiration_date': '2025-12-11t09:00:00z',
'fuel_type': 'diesel',
'id': '8421b284-257e-5d29-9825-a3e2a3338a43',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'fv64aeu',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/audi/a6?id=1424731',
'listing': 'auction',
'location': 'colchester',
'make': 'audi',
'make_model': 'audi a6',
'model': 'a6',
'odometer': 215060,
'odometer_in_km': 346104,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 50,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154728,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154728,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199260,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 153407,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 149462,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154403,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154256,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 149006,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151031,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189719,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 254555,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 269061,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 241674,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338950,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275937,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272613,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 395465,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386281,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433437,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351741,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-30',
'sanitized_make': 'audi',
'seller_name': 'harwoods group',
'title': 'audi a6 2.0 tdi ultra s line 4dr s tronic',
'transmission': 'automatic',
'trim': '2.0 tdi ultra s line 4dr s tronic',
'year': 2015}
2025-12-05 20:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 8421b284-257e-5d29-9825-a3e2a3338a43 spider: manheim.gb
2025-12-05 20:01:32 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 8421b284-257e-5d29-9825-a3e2a3338a43 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 50, 'seller_name': 'harwoods group', 'price_includes_vat': False, 'title': 'audi a6 2.0 tdi ultra s line 4dr s tronic', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'a6', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 215060, 'odometer_reading_unit': 'mi', 'registration_date': '2015-01-30', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/audi/a6?id=1424731', 'location': 'colchester', 'origin_country_code': 'gb', 'trim': '2.0 tdi ultra s line 4dr s tronic', 'license_plate': 'fv64aeu', 'year': 2015, 'listing': 'auction', 'c_o_2_emission_value': 114, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001424731-01989538-002.pdf', 'expiration_date': '2025-12-11t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '8421b284-257e-5d29-9825-a3e2a3338a43', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_expert_report_file_938d9412-663c-4b73-b0c6-5bdf8be9337e.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 154728}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 154728}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 199260}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 153407}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_5.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 149462}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_4.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 154403}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_11.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 154256}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_10.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 149006}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_9.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 151031}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 189719}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 254555}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 269061}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 241674}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 338950}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 275937}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 272613}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 395465}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 386281}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 433437}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 351741}], 'current_year_diff': 10, 'age_in_months': 130, 'make_model': 'audi a6', 'sanitized_make': 'audi', 'odometer_in_km': 346104}
Failed validating None in schema:
False
On instance:
{'age_in_months': 130,
'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_expert_report_file_938d9412-663c-4b73-b0c6-5bdf8be9337e.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001424731-01989538-002.pdf',
'color': 'black',
'currency': 'gbp',
'current_year_diff': 10,
'engine': '2.0l',
'expiration_date': '2025-12-11t09:00:00z',
'fuel_type': 'diesel',
'id': '8421b284-257e-5d29-9825-a3e2a3338a43',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'fv64aeu',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/audi/a6?id=1424731',
'listing': 'auction',
'location': 'colchester',
'make': 'audi',
'make_model': 'audi a6',
'model': 'a6',
'odometer': 215060,
'odometer_in_km': 346104,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 50,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154728,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154728,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199260,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 153407,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 149462,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154403,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154256,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 149006,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151031,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189719,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 254555,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 269061,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 241674,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338950,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275937,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272613,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 395465,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386281,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433437,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351741,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-30',
'sanitized_make': 'audi',
'seller_name': 'harwoods group',
'title': 'audi a6 2.0 tdi ultra s line 4dr s tronic',
'transmission': 'automatic',
'trim': '2.0 tdi ultra s line 4dr s tronic',
'year': 2015}
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_expert_report_file_938d9412-663c-4b73-b0c6-5bdf8be9337e.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001424731-01989538-002.pdf',
'color': 'Black',
'currency': 'GBP',
'engine': '2.0L',
'expiration_date': '2025-12-11T09:00:00Z',
'fuel_type': 'Diesel',
'id': '8421b284-257e-5d29-9825-a3e2a3338a43',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FV64AEU',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/A6?id=1424731',
'listing': 'auction',
'location': 'Colchester',
'make': 'AUDI',
'model': 'A6',
'odometer': 215060,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 50,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154728,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154728,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199260,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 153407,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 149462,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154403,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154256,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 149006,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151031,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189719,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 254555,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 269061,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 241674,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/69b0539e-5cfa-4f3f-ba68-01c7664685a0_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338950,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275937,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272613,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 395465,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386281,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433437,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8421b284-257e-5d29-9825-a3e2a3338a43/8421b284-257e-5d29-9825-a3e2a3338a43_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351741,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1424731-4009638-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-30',
'seller_name': 'Harwoods Group',
'title': 'AUDI A6 2.0 TDI Ultra S Line 4dr S Tronic',
'transmission': 'automatic',
'trim': '2.0 TDI Ultra S Line 4dr S Tronic',
'year': 2015}
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271424731%27 HTTP/1.1" 200 None
2025-12-05 20:01:32 [manheim.gb] INFO: Saving data for 1424731: {'created_time': 1764964892.380595, 'last_price_update_time': 1764964892.380605, 'auction_closing_time': 1765443600.0}
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1424731') HTTP/1.1" 204 0
2025-12-05 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1196641-4009708-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001196641-01989766-005.pdf)
2025-12-05 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1196641-4009708-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001196641-01989766-005.pdf)
2025-12-05 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1196641-4009708-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001196641-01989766-005.pdf)
2025-12-05 20:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6431ed10>
2025-12-05 20:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_17.jpg HTTP/1.1" 201 0
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1196641-4009708-1003.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1196641-4009708-1003.jpg saved to cache
2025-12-05 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item b77bcaaf-cd63-5637-b64e-726bcda6367c
2025-12-05 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001196641-01989766-005.pdf)
2025-12-05 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1196641-4009708-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001196641-01989766-005.pdf)
2025-12-05 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001196641-01989766-005.pdf)
2025-12-05 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001196641-01989766-005.pdf)
2025-12-05 20:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fbae550>
2025-12-05 20:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_16.jpg HTTP/1.1" 201 0
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1196641-4009708-1002.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1196641-4009708-1002.jpg saved to cache
2025-12-05 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item b77bcaaf-cd63-5637-b64e-726bcda6367c
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fbac6d0>
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_15.jpg HTTP/1.1" 201 0
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1196641-4009708-1001.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1196641-4009708-1001.jpg saved to cache
2025-12-05 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item b77bcaaf-cd63-5637-b64e-726bcda6367c
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640d3ed0>
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1196641-4009708-1000.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1196641-4009708-1000.jpg saved to cache
2025-12-05 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item b77bcaaf-cd63-5637-b64e-726bcda6367c
2025-12-05 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/DS/DS4?id=1541191&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231541191&indx=35> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001196641-01989766-005.pdf)
2025-12-05 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001164897-01992879-001.pdf)
2025-12-05 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001196641-01989766-005.pdf)
2025-12-05 20:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc642fa210>
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_4.jpg saved to cache
2025-12-05 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item b77bcaaf-cd63-5637-b64e-726bcda6367c
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e51b950>
2025-12-05 20:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1196641-4009708-13.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1196641-4009708-13.jpg saved to cache
2025-12-05 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item b77bcaaf-cd63-5637-b64e-726bcda6367c
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64090390>
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_11.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_11.jpg saved to cache
2025-12-05 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b77bcaaf-cd63-5637-b64e-726bcda6367c
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2cc650>
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_4.jpg saved to cache
2025-12-05 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b77bcaaf-cd63-5637-b64e-726bcda6367c
2025-12-05 20:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/HYUNDAI/IX20?id=1564179&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231564179&indx=36> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f9cc0f6-8f1c-550d-a3b4-e095cb0e8c4d with identifier: 1541191
2025-12-05 20:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f9cc0f6-8f1c-550d-a3b4-e095cb0e8c4d with scrape type 2
2025-12-05 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f9cc0f6-8f1c-550d-a3b4-e095cb0e8c4d with scrape type 2
2025-12-05 20:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 7f9cc0f6-8f1c-550d-a3b4-e095cb0e8c4d, identifier: 1541191
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640d97d0>
2025-12-05 20:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_1.jpg saved to cache
2025-12-05 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b77bcaaf-cd63-5637-b64e-726bcda6367c
2025-12-05 20:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e519a10>
2025-12-05 20:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_6.jpg saved to cache
2025-12-05 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item feb141fb-ed11-587f-b5b8-efa878ee240c
2025-12-05 20:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2d0390>
2025-12-05 20:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_5.jpg saved to cache
2025-12-05 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b77bcaaf-cd63-5637-b64e-726bcda6367c
2025-12-05 20:01:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b77bcaaf-cd63-5637-b64e-726bcda6367c, skipping ID generation
2025-12-05 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b77bcaaf-cd63-5637-b64e-726bcda6367c from tracking dictionaries
2025-12-05 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b77bcaaf-cd63-5637-b64e-726bcda6367c sending to next pipeline
2025-12-05 20:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: b77bcaaf-cd63-5637-b64e-726bcda6367c, identifier: 1196641
2025-12-05 20:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001164897-01992879-001.pdf)
2025-12-05 20:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001164897-01992879-001.pdf)
2025-12-05 20:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 7f9cc0f6-8f1c-550d-a3b4-e095cb0e8c4d with identifier: 1541191
2025-12-05 20:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 7f9cc0f6-8f1c-550d-a3b4-e095cb0e8c4d with identifier: 1541191
2025-12-05 20:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 7f9cc0f6-8f1c-550d-a3b4-e095cb0e8c4d with identifier: 1541191 to the API
2025-12-05 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/DS/DS4?id=1541191&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231541191&indx=35>
{'auction_title': '',
'c_o_2_emission_value': 103,
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001541191-01986958-004.pdf',
'color': 'WHITE',
'currency': 'GBP',
'engine': '1.6L',
'expiration_date': '2025-12-09T09:00:00Z',
'fuel_type': 'Diesel',
'id': '7f9cc0f6-8f1c-550d-a3b4-e095cb0e8c4d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NU16RKE',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/DS/DS%204?id=1541191',
'listing': 'auction',
'location': 'Shotts',
'make': 'DS',
'model': 'DS 4',
'odometer': 79280,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-16',
'seller_name': 'Parks Motor Group',
'title': 'DS DS 4 1.6 BlueHDi Prestige 5dr',
'transmission': 'manual',
'trim': '1.6 BlueHDi Prestige 5dr',
'year': 2016}
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271541191%27 HTTP/1.1" 200 None
2025-12-05 20:01:36 [manheim.gb] INFO: Saving data for 1541191: {'auction_closing_time': 1765270800.0, 'created_time': 1764584185.261476, 'last_price_update_time': 1764964896.030793}
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1541191') HTTP/1.1" 204 0
2025-12-05 20:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: b77bcaaf-cd63-5637-b64e-726bcda6367c with identifier: 1196641
2025-12-05 20:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: b77bcaaf-cd63-5637-b64e-726bcda6367c with identifier: 1196641
2025-12-05 20:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
2025-12-05 20:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: b77bcaaf-cd63-5637-b64e-726bcda6367c spider: manheim.gb
2025-12-05 20:01:36 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: b77bcaaf-cd63-5637-b64e-726bcda6367c due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_expert_report_file_3f30a6eb-1ac4-46fb-9124-526f095d172a.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001196641-01989766-005.pdf',
'color': 'BLACK',
'currency': 'GBP',
'engine': '1.0L',
'expiration_date': '2025-12-08T09:00:00Z',
'fuel_type': 'Petrol',
'id': 'b77bcaaf-cd63-5637-b64e-726bcda6367c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AP64FKO',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/KIA/PICANTO?id=1196641',
'listing': 'auction',
'location': 'Leeds',
'make': 'KIA',
'model': 'PICANTO',
'odometer': 57665,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 39,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 225788,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 225788,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260161,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 160389,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187251,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 185741,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 183708,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180619,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186801,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 255013,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277899,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253843,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295480,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2d932bec-f3c8-4b16-aedb-1f3b5f7b297b_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 464474,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1196641-4009708-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198257,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1196641-4009708-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237480,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1196641-4009708-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328835,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1196641-4009708-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 278959,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1196641-4009708-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362533,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1196641-4009708-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b77bcaaf-cd63-5637-b64e-726bcda6367c/b77bcaaf-cd63-5637-b64e-726bcda6367c_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302201,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1196641-4009708-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-27',
'seller_name': 'Lookers',
'title': 'KIA PICANTO 1.0 VR7 5dr',
'transmission': 'manual',
'trim': '1.0 VR7 5dr',
'year': 2015}
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271196641%27 HTTP/1.1" 200 None
2025-12-05 20:01:36 [manheim.gb] INFO: Saving data for 1196641: {'created_time': 1764964896.261392, 'last_price_update_time': 1764964896.261401, 'auction_closing_time': 1765184400.0}
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1196641') HTTP/1.1" 204 0
2025-12-05 20:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001483148-01992942-002.pdf)
2025-12-05 20:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001483148-01992942-002.pdf)
2025-12-05 20:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001483148-01992942-002.pdf)
2025-12-05 20:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9200c31a-aec5-5dca-8036-0876fcfb70f2 with identifier: 1564179
2025-12-05 20:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9200c31a-aec5-5dca-8036-0876fcfb70f2 with scrape type 2
2025-12-05 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9200c31a-aec5-5dca-8036-0876fcfb70f2 with scrape type 2
2025-12-05 20:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 9200c31a-aec5-5dca-8036-0876fcfb70f2, identifier: 1564179
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6451c390>
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_7.jpg saved to cache
2025-12-05 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item feb141fb-ed11-587f-b5b8-efa878ee240c
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6428a7d0>
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_7.jpg saved to cache
2025-12-05 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item feb141fb-ed11-587f-b5b8-efa878ee240c
2025-12-05 20:01:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: feb141fb-ed11-587f-b5b8-efa878ee240c, skipping ID generation
2025-12-05 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item feb141fb-ed11-587f-b5b8-efa878ee240c from tracking dictionaries
2025-12-05 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item feb141fb-ed11-587f-b5b8-efa878ee240c sending to next pipeline
2025-12-05 20:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: feb141fb-ed11-587f-b5b8-efa878ee240c, identifier: 1164897
2025-12-05 20:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001483148-01992942-002.pdf)
2025-12-05 20:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 9200c31a-aec5-5dca-8036-0876fcfb70f2 with identifier: 1564179
2025-12-05 20:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 9200c31a-aec5-5dca-8036-0876fcfb70f2 with identifier: 1564179
2025-12-05 20:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 12 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
12
2025-12-05 20:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 9200c31a-aec5-5dca-8036-0876fcfb70f2 spider: manheim.gb
2025-12-05 20:01:37 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 9200c31a-aec5-5dca-8036-0876fcfb70f2 due to rule: registration_date_old.json, error: 12 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
12
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001564179-01991001-002.pdf',
'color': 'WHITE',
'currency': 'GBP',
'engine': '1.4L',
'expiration_date': '2025-12-08T09:00:00Z',
'fuel_type': 'Petrol',
'id': '9200c31a-aec5-5dca-8036-0876fcfb70f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YF13FKO',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/HYUNDAI/IX20?id=1564179',
'listing': 'auction',
'location': 'Leeds',
'make': 'HYUNDAI',
'model': 'IX20',
'odometer': 66794,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-26',
'seller_name': 'Big Motoring World Ltd',
'title': 'HYUNDAI IX20 1.4 Active 5dr',
'transmission': 'manual',
'trim': '1.4 Active 5dr',
'year': 2013}
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271564179%27 HTTP/1.1" 200 None
2025-12-05 20:01:37 [manheim.gb] INFO: Saving data for 1564179: {'auction_closing_time': 1765184400.0, 'created_time': 1764842936.139761, 'last_price_update_time': 1764964897.244369}
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1564179') HTTP/1.1" 204 0
2025-12-05 20:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: feb141fb-ed11-587f-b5b8-efa878ee240c with identifier: 1164897
2025-12-05 20:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: feb141fb-ed11-587f-b5b8-efa878ee240c with identifier: 1164897
2025-12-05 20:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 187219 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
187219
2025-12-05 20:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: feb141fb-ed11-587f-b5b8-efa878ee240c spider: manheim.gb
2025-12-05 20:01:37 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: feb141fb-ed11-587f-b5b8-efa878ee240c due to rule: high_mileage_for_country.json, error: 187219 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
187219
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_expert_report_file_dfc5444b-0e50-4a14-9450-fe513fbbfd45.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001164897-01992879-001.pdf',
'color': 'Black',
'currency': 'GBP',
'engine': '2.2L',
'expiration_date': '2025-12-12T09:00:00Z',
'fuel_type': 'Diesel',
'id': 'feb141fb-ed11-587f-b5b8-efa878ee240c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RK14LVG',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/C%20CLASS?id=1164897',
'listing': 'auction',
'location': 'Birmingham',
'make': 'MERCEDES-BENZ',
'model': 'C CLASS',
'odometer': 116333,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 33,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 194145,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 194145,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192602,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184640,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195447,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195447,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192656,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196261,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210620,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192260,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180676,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 202276,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 230216,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d72420e9-3f2c-4b53-a506-45b3ab6e4fde_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317178,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1164897-4010084-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 434511,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1164897-4010084-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 393667,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1164897-4010084-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280241,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1164897-4010084-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 270190,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1164897-4010084-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242615,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1164897-4010084-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feb141fb-ed11-587f-b5b8-efa878ee240c/feb141fb-ed11-587f-b5b8-efa878ee240c_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186866,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1164897-4010084-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-30',
'seller_name': 'Sandicliffe',
'title': 'MERCEDES-BENZ C CLASS C220 CDI AMG Sport Edition 5dr Auto [Premium '
'Plus]',
'transmission': 'automatic',
'trim': 'C220 CDI AMG Sport Edition 5dr Auto [Premium Plus]',
'year': 2014}
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271164897%27 HTTP/1.1" 200 None
2025-12-05 20:01:37 [manheim.gb] INFO: Saving data for 1164897: {'created_time': 1764964897.501771, 'last_price_update_time': 1764964897.501781, 'auction_closing_time': 1765530000.0}
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1164897') HTTP/1.1" 204 0
2025-12-05 20:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MINI/CLUBMAN?id=1512515&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231512515&indx=33> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001483148-01992942-002.pdf)
2025-12-05 20:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001483148-01992942-002.pdf)
2025-12-05 20:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001483148-01992942-002.pdf)
2025-12-05 20:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e4fded0>
2025-12-05 20:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F05fff5d2-8914-42ff-a630-293c2aec363d_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_5.jpg saved to cache
2025-12-05 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 34b9ed7f-19f8-5791-bced-0a85f823689a
2025-12-05 20:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6585c790>
2025-12-05 20:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F05fff5d2-8914-42ff-a630-293c2aec363d_10.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_10.jpg saved to cache
2025-12-05 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 34b9ed7f-19f8-5791-bced-0a85f823689a
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64166890>
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F05fff5d2-8914-42ff-a630-293c2aec363d_9.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_9.jpg saved to cache
2025-12-05 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 34b9ed7f-19f8-5791-bced-0a85f823689a
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64166f90>
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F05fff5d2-8914-42ff-a630-293c2aec363d_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_2.jpg saved to cache
2025-12-05 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 34b9ed7f-19f8-5791-bced-0a85f823689a
2025-12-05 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001483148-01992942-002.pdf)
2025-12-05 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001483148-01992942-002.pdf)
2025-12-05 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=1589816&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231589816&indx=38> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001483148-01992942-002.pdf)
2025-12-05 20:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ece1f6a2-0b48-5604-adc2-850b2ea40751 with identifier: 1512515
2025-12-05 20:01:38 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ece1f6a2-0b48-5604-adc2-850b2ea40751
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e4ee810>
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F05fff5d2-8914-42ff-a630-293c2aec363d_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_1.jpg saved to cache
2025-12-05 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 34b9ed7f-19f8-5791-bced-0a85f823689a
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f205790>
2025-12-05 20:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F05fff5d2-8914-42ff-a630-293c2aec363d_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_5.jpg saved to cache
2025-12-05 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 34b9ed7f-19f8-5791-bced-0a85f823689a
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f23ddd0>
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F05fff5d2-8914-42ff-a630-293c2aec363d_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_4.jpg saved to cache
2025-12-05 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 34b9ed7f-19f8-5791-bced-0a85f823689a
2025-12-05 20:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001123228-01987612-002.pdf)
2025-12-05 20:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001483148-01992942-002.pdf)
2025-12-05 20:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/BMW/1SERIES?id=1761741&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231761741&indx=55> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001123228-01987612-002.pdf)
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fbadc50>
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F05fff5d2-8914-42ff-a630-293c2aec363d_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_7.jpg saved to cache
2025-12-05 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 34b9ed7f-19f8-5791-bced-0a85f823689a
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fbadc50>
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F05fff5d2-8914-42ff-a630-293c2aec363d_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_7.jpg saved to cache
2025-12-05 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 34b9ed7f-19f8-5791-bced-0a85f823689a
2025-12-05 20:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 652cbaa6-caba-53bf-9524-0d49c3ca865e with identifier: 1589816
2025-12-05 20:01:39 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 652cbaa6-caba-53bf-9524-0d49c3ca865e
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc642fa550>
2025-12-05 20:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F05fff5d2-8914-42ff-a630-293c2aec363d_11.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_11.jpg saved to cache
2025-12-05 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 34b9ed7f-19f8-5791-bced-0a85f823689a
2025-12-05 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001123228-01987612-002.pdf)
2025-12-05 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001123228-01987612-002.pdf)
2025-12-05 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001123228-01987612-002.pdf)
2025-12-05 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001123228-01987612-002.pdf)
2025-12-05 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001123228-01987612-002.pdf)
2025-12-05 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search) ['zyte-api']
2025-12-05 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001123228-01987612-002.pdf)
2025-12-05 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001123228-01987612-002.pdf)
2025-12-05 20:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640e2210>
2025-12-05 20:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_18.jpg HTTP/1.1" 201 0
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1123228-4009786-1004.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1004.jpg saved to cache
2025-12-05 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 527bd38b-bb30-52cf-b049-0cd34e2be0bf
2025-12-05 20:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f21ebd0>
2025-12-05 20:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F05fff5d2-8914-42ff-a630-293c2aec363d_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_6.jpg saved to cache
2025-12-05 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 34b9ed7f-19f8-5791-bced-0a85f823689a
2025-12-05 20:01:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 34b9ed7f-19f8-5791-bced-0a85f823689a, skipping ID generation
2025-12-05 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 34b9ed7f-19f8-5791-bced-0a85f823689a from tracking dictionaries
2025-12-05 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 34b9ed7f-19f8-5791-bced-0a85f823689a sending to next pipeline
2025-12-05 20:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 34b9ed7f-19f8-5791-bced-0a85f823689a, identifier: 1483148
2025-12-05 20:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08d45d44-06c8-5777-ab82-d212449d4408 with identifier: 1761741
2025-12-05 20:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08d45d44-06c8-5777-ab82-d212449d4408 with scrape type 2
2025-12-05 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08d45d44-06c8-5777-ab82-d212449d4408 with scrape type 2
2025-12-05 20:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 08d45d44-06c8-5777-ab82-d212449d4408, identifier: 1761741
2025-12-05 20:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc641e4890>
2025-12-05 20:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_4.jpg saved to cache
2025-12-05 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 527bd38b-bb30-52cf-b049-0cd34e2be0bf
2025-12-05 20:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 34b9ed7f-19f8-5791-bced-0a85f823689a with identifier: 1483148
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BROWN HTTP/1.1" 200 None
2025-12-05 20:01:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 34b9ed7f-19f8-5791-bced-0a85f823689a with identifier: 1483148
2025-12-05 20:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'brown', 'original_photo_count': 21, 'seller_name': 'big motoring world ltd', 'price_includes_vat': False, 'title': 'ford mondeo 2.0 tdci 163 titanium x business edition 5dr', 'price': 0, 'currency': 'gbp', 'make': 'ford', 'model': 'mondeo', 'transmission': 'manual', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 163221, 'odometer_reading_unit': 'mi', 'registration_date': '2014-03-24', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/ford/mondeo?id=1483148', 'location': 'leeds', 'origin_country_code': 'gb', 'trim': '2.0 tdci 163 titanium x business edition 5dr', 'license_plate': 'nk14ueb', 'year': 2014, 'listing': 'auction', 'c_o_2_emission_value': 119, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001483148-01992942-002.pdf', 'expiration_date': '2025-12-08t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '34b9ed7f-19f8-5791-bced-0a85f823689a', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_expert_report_file_860f6c47-5cb1-4dc8-b183-cb0fa990d081.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 198090}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 198090}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 253058}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 188857}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 184641}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 198385}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 171513}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 194420}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 208977}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 311785}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 197802}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 206407}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 233403}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 318789}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 249213}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 345003}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 172751}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 246550}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 373976}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 304626}], 'current_year_diff': 11, 'age_in_months': 140, 'make_model': 'ford mondeo', 'sanitized_make': 'ford', 'odometer_in_km': 262678}
Failed validating None in schema:
False
On instance:
{'age_in_months': 140,
'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_expert_report_file_860f6c47-5cb1-4dc8-b183-cb0fa990d081.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001483148-01992942-002.pdf',
'color': 'brown',
'currency': 'gbp',
'current_year_diff': 11,
'engine': '2.0l',
'expiration_date': '2025-12-08t09:00:00z',
'fuel_type': 'diesel',
'id': '34b9ed7f-19f8-5791-bced-0a85f823689a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'nk14ueb',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/ford/mondeo?id=1483148',
'listing': 'auction',
'location': 'leeds',
'make': 'ford',
'make_model': 'ford mondeo',
'model': 'mondeo',
'odometer': 163221,
'odometer_in_km': 262678,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198090,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198090,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253058,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188857,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184641,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198385,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 171513,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 194420,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 208977,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311785,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197802,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 206407,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 233403,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318789,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 249213,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345003,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172751,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 246550,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 373976,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304626,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-24',
'sanitized_make': 'ford',
'seller_name': 'big motoring world ltd',
'title': 'ford mondeo 2.0 tdci 163 titanium x business edition 5dr',
'transmission': 'manual',
'trim': '2.0 tdci 163 titanium x business edition 5dr',
'year': 2014}
2025-12-05 20:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 34b9ed7f-19f8-5791-bced-0a85f823689a spider: manheim.gb
2025-12-05 20:01:41 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 34b9ed7f-19f8-5791-bced-0a85f823689a due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'brown', 'original_photo_count': 21, 'seller_name': 'big motoring world ltd', 'price_includes_vat': False, 'title': 'ford mondeo 2.0 tdci 163 titanium x business edition 5dr', 'price': 0, 'currency': 'gbp', 'make': 'ford', 'model': 'mondeo', 'transmission': 'manual', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 163221, 'odometer_reading_unit': 'mi', 'registration_date': '2014-03-24', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/ford/mondeo?id=1483148', 'location': 'leeds', 'origin_country_code': 'gb', 'trim': '2.0 tdci 163 titanium x business edition 5dr', 'license_plate': 'nk14ueb', 'year': 2014, 'listing': 'auction', 'c_o_2_emission_value': 119, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001483148-01992942-002.pdf', 'expiration_date': '2025-12-08t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '34b9ed7f-19f8-5791-bced-0a85f823689a', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_expert_report_file_860f6c47-5cb1-4dc8-b183-cb0fa990d081.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 198090}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 198090}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 253058}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 188857}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 184641}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 198385}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 171513}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 194420}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 208977}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 311785}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 197802}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 206407}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 233403}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 318789}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 249213}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 345003}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 172751}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 246550}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 373976}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 304626}], 'current_year_diff': 11, 'age_in_months': 140, 'make_model': 'ford mondeo', 'sanitized_make': 'ford', 'odometer_in_km': 262678}
Failed validating None in schema:
False
On instance:
{'age_in_months': 140,
'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_expert_report_file_860f6c47-5cb1-4dc8-b183-cb0fa990d081.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001483148-01992942-002.pdf',
'color': 'brown',
'currency': 'gbp',
'current_year_diff': 11,
'engine': '2.0l',
'expiration_date': '2025-12-08t09:00:00z',
'fuel_type': 'diesel',
'id': '34b9ed7f-19f8-5791-bced-0a85f823689a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'nk14ueb',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/ford/mondeo?id=1483148',
'listing': 'auction',
'location': 'leeds',
'make': 'ford',
'make_model': 'ford mondeo',
'model': 'mondeo',
'odometer': 163221,
'odometer_in_km': 262678,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198090,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198090,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253058,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188857,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184641,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198385,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 171513,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 194420,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 208977,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311785,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197802,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 206407,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 233403,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318789,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 249213,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345003,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172751,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 246550,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 373976,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304626,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-24',
'sanitized_make': 'ford',
'seller_name': 'big motoring world ltd',
'title': 'ford mondeo 2.0 tdci 163 titanium x business edition 5dr',
'transmission': 'manual',
'trim': '2.0 tdci 163 titanium x business edition 5dr',
'year': 2014}
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_expert_report_file_860f6c47-5cb1-4dc8-b183-cb0fa990d081.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001483148-01992942-002.pdf',
'color': 'BROWN',
'currency': 'GBP',
'engine': '2.0L',
'expiration_date': '2025-12-08T09:00:00Z',
'fuel_type': 'Diesel',
'id': '34b9ed7f-19f8-5791-bced-0a85f823689a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NK14UEB',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/MONDEO?id=1483148',
'listing': 'auction',
'location': 'Leeds',
'make': 'FORD',
'model': 'MONDEO',
'odometer': 163221,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198090,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198090,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253058,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188857,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184641,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198385,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 171513,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 194420,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 208977,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311785,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197802,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 206407,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 233403,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/05fff5d2-8914-42ff-a630-293c2aec363d_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318789,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 249213,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345003,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172751,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 246550,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 373976,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34b9ed7f-19f8-5791-bced-0a85f823689a/34b9ed7f-19f8-5791-bced-0a85f823689a_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304626,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1483148-4009544-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-24',
'seller_name': 'Big Motoring World Ltd',
'title': 'FORD MONDEO 2.0 TDCi 163 Titanium X Business Edition 5dr',
'transmission': 'manual',
'trim': '2.0 TDCi 163 Titanium X Business Edition 5dr',
'year': 2014}
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271483148%27 HTTP/1.1" 200 None
2025-12-05 20:01:41 [manheim.gb] INFO: Saving data for 1483148: {'created_time': 1764964901.826526, 'last_price_update_time': 1764964901.826538, 'auction_closing_time': 1765184400.0}
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1483148') HTTP/1.1" 204 0
2025-12-05 20:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 08d45d44-06c8-5777-ab82-d212449d4408 with identifier: 1761741
2025-12-05 20:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 08d45d44-06c8-5777-ab82-d212449d4408 with identifier: 1761741
2025-12-05 20:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
2025-12-05 20:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 08d45d44-06c8-5777-ab82-d212449d4408 spider: manheim.gb
2025-12-05 20:01:42 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 08d45d44-06c8-5777-ab82-d212449d4408 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
{'auction_title': '',
'c_o_2_emission_value': 126,
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001761741-01991419-004.pdf',
'color': 'WHITE',
'currency': 'GBP',
'engine': '1.5L',
'expiration_date': '2025-12-09T09:00:00Z',
'fuel_type': 'Petrol',
'id': '08d45d44-06c8-5777-ab82-d212449d4408',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LO65XUG',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/BMW/1%20SERIES?id=1761741',
'listing': 'auction',
'location': 'Manchester',
'make': 'BMW',
'model': '1 SERIES',
'odometer': 89771,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-31',
'seller_name': 'Swansway Garages',
'title': 'BMW 1 SERIES 118i [1.5] M Sport 5dr',
'transmission': 'manual',
'trim': '118i [1.5] M Sport 5dr',
'year': 2015}
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271761741%27 HTTP/1.1" 200 None
2025-12-05 20:01:42 [manheim.gb] INFO: Saving data for 1761741: {'auction_closing_time': 1765270800.0, 'created_time': 1764842936.400448, 'last_price_update_time': 1764964902.082053}
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1761741') HTTP/1.1" 204 0
2025-12-05 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001123228-01987612-002.pdf)
2025-12-05 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001123228-01987612-002.pdf)
2025-12-05 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001123228-01987612-002.pdf)
2025-12-05 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001123228-01987612-002.pdf)
2025-12-05 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001123228-01987612-002.pdf)
2025-12-05 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001123228-01987612-002.pdf)
2025-12-05 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001123228-01987612-002.pdf)
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64369b50>
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_16.jpg HTTP/1.1" 201 0
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1123228-4009786-1002.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1002.jpg saved to cache
2025-12-05 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 527bd38b-bb30-52cf-b049-0cd34e2be0bf
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6436bad0>
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_15.jpg HTTP/1.1" 201 0
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1123228-4009786-1001.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1001.jpg saved to cache
2025-12-05 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 527bd38b-bb30-52cf-b049-0cd34e2be0bf
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc644da210>
2025-12-05 20:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_17.jpg HTTP/1.1" 201 0
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1123228-4009786-1003.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1003.jpg saved to cache
2025-12-05 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 527bd38b-bb30-52cf-b049-0cd34e2be0bf
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64359310>
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1123228-4009786-1000.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1000.jpg saved to cache
2025-12-05 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 527bd38b-bb30-52cf-b049-0cd34e2be0bf
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc644d0390>
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1123228-4009786-13.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-13.jpg saved to cache
2025-12-05 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 527bd38b-bb30-52cf-b049-0cd34e2be0bf
2025-12-05 20:01:43 [manheim.gb] INFO: Found listing with ID: 2354571
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272354571%27 HTTP/1.1" 200 None
2025-12-05 20:01:43 [manheim.gb] INFO: Scrape type for 2354571: 0
2025-12-05 20:01:43 [manheim.gb] INFO: Found listing with ID: 2374569
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272374569%27 HTTP/1.1" 200 None
2025-12-05 20:01:43 [manheim.gb] INFO: Scrape type for 2374569: 0
2025-12-05 20:01:43 [manheim.gb] INFO: Found listing with ID: 2383536
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272383536%27 HTTP/1.1" 200 None
2025-12-05 20:01:43 [manheim.gb] INFO: Scrape type for 2383536: 1
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc644c5c50>
2025-12-05 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_3.jpg saved to cache
2025-12-05 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 527bd38b-bb30-52cf-b049-0cd34e2be0bf
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc641acc50>
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_5.jpg saved to cache
2025-12-05 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 527bd38b-bb30-52cf-b049-0cd34e2be0bf
2025-12-05 20:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001123228-01987612-002.pdf)
2025-12-05 20:01:44 [manheim.gb] INFO: Found listing with ID: 2383831
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272383831%27 HTTP/1.1" 200 None
2025-12-05 20:01:44 [manheim.gb] INFO: Scrape type for 2383831: 0
2025-12-05 20:01:44 [manheim.gb] INFO: Found listing with ID: 2390902
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272390902%27 HTTP/1.1" 200 None
2025-12-05 20:01:44 [manheim.gb] INFO: Scrape type for 2390902: 1
2025-12-05 20:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=1773610&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231773610&indx=56> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/ASTRA?id=1926821&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231926821&indx=64> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:01:44 [manheim.gb] INFO: Found listing with ID: 2392879
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272392879%27 HTTP/1.1" 200 None
2025-12-05 20:01:44 [manheim.gb] INFO: Scrape type for 2392879: 1
2025-12-05 20:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001123228-01987612-002.pdf)
2025-12-05 20:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001123228-01987612-002.pdf)
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fbfa210>
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3d4a2641-8871-481a-9f78-5fdbfd95a0d9_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_5.jpg saved to cache
2025-12-05 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 527bd38b-bb30-52cf-b049-0cd34e2be0bf
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2f2890>
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3d4a2641-8871-481a-9f78-5fdbfd95a0d9_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_4.jpg saved to cache
2025-12-05 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 527bd38b-bb30-52cf-b049-0cd34e2be0bf
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f248650>
2025-12-05 20:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3d4a2641-8871-481a-9f78-5fdbfd95a0d9_11.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_11.jpg saved to cache
2025-12-05 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 527bd38b-bb30-52cf-b049-0cd34e2be0bf
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2f1090>
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3d4a2641-8871-481a-9f78-5fdbfd95a0d9_10.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_10.jpg saved to cache
2025-12-05 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 527bd38b-bb30-52cf-b049-0cd34e2be0bf
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2b2210>
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3d4a2641-8871-481a-9f78-5fdbfd95a0d9_9.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_9.jpg saved to cache
2025-12-05 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 527bd38b-bb30-52cf-b049-0cd34e2be0bf
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc641d8ad0>
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_2.jpg saved to cache
2025-12-05 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 527bd38b-bb30-52cf-b049-0cd34e2be0bf
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6446f590>
2025-12-05 20:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_1.jpg saved to cache
2025-12-05 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 527bd38b-bb30-52cf-b049-0cd34e2be0bf
2025-12-05 20:01:46 [manheim.gb] INFO: Found listing with ID: 2395632
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272395632%27 HTTP/1.1" 200 None
2025-12-05 20:01:46 [manheim.gb] INFO: Scrape type for 2395632: 0
2025-12-05 20:01:46 [manheim.gb] INFO: Found listing with ID: 2407950
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272407950%27 HTTP/1.1" 200 None
2025-12-05 20:01:46 [manheim.gb] INFO: Scrape type for 2407950: 0
2025-12-05 20:01:46 [manheim.gb] INFO: Found listing with ID: 2408993
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272408993%27 HTTP/1.1" 200 None
2025-12-05 20:01:46 [manheim.gb] INFO: Scrape type for 2408993: 0
2025-12-05 20:01:46 [manheim.gb] INFO: Found listing with ID: 2413019
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272413019%27 HTTP/1.1" 200 None
2025-12-05 20:01:46 [manheim.gb] INFO: Scrape type for 2413019: 1
2025-12-05 20:01:46 [manheim.gb] INFO: Found listing with ID: 2414514
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272414514%27 HTTP/1.1" 200 None
2025-12-05 20:01:46 [manheim.gb] INFO: Scrape type for 2414514: 0
2025-12-05 20:01:46 [manheim.gb] INFO: Found listing with ID: 2437613
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272437613%27 HTTP/1.1" 200 None
2025-12-05 20:01:46 [manheim.gb] INFO: Scrape type for 2437613: 0
2025-12-05 20:01:46 [manheim.gb] INFO: Found listing with ID: 2443996
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272443996%27 HTTP/1.1" 200 None
2025-12-05 20:01:46 [manheim.gb] INFO: Scrape type for 2443996: 0
2025-12-05 20:01:46 [manheim.gb] INFO: Found listing with ID: 2445301
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272445301%27 HTTP/1.1" 200 None
2025-12-05 20:01:46 [manheim.gb] INFO: Scrape type for 2445301: 0
2025-12-05 20:01:46 [manheim.gb] INFO: Found listing with ID: 2449653
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272449653%27 HTTP/1.1" 200 None
2025-12-05 20:01:46 [manheim.gb] INFO: Scrape type for 2449653: 0
2025-12-05 20:01:46 [manheim.gb] INFO: Found listing with ID: 2454963
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272454963%27 HTTP/1.1" 200 None
2025-12-05 20:01:46 [manheim.gb] INFO: Scrape type for 2454963: 0
2025-12-05 20:01:46 [manheim.gb] INFO: Found listing with ID: 2456004
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272456004%27 HTTP/1.1" 200 None
2025-12-05 20:01:46 [manheim.gb] INFO: Scrape type for 2456004: 0
2025-12-05 20:01:46 [manheim.gb] INFO: Found listing with ID: 24566
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%2724566%27 HTTP/1.1" 200 None
2025-12-05 20:01:46 [manheim.gb] INFO: Scrape type for 24566: 0
2025-12-05 20:01:46 [manheim.gb] INFO: Found listing with ID: 2458076
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272458076%27 HTTP/1.1" 200 None
2025-12-05 20:01:46 [manheim.gb] INFO: Scrape type for 2458076: 0
2025-12-05 20:01:46 [manheim.gb] INFO: Found listing with ID: 2461241
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272461241%27 HTTP/1.1" 200 None
2025-12-05 20:01:46 [manheim.gb] INFO: Scrape type for 2461241: 0
2025-12-05 20:01:46 [manheim.gb] INFO: Found listing with ID: 2528107
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272528107%27 HTTP/1.1" 200 None
2025-12-05 20:01:46 [manheim.gb] INFO: Scrape type for 2528107: 0
2025-12-05 20:01:46 [manheim.gb] INFO: Found listing with ID: 2528639
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272528639%27 HTTP/1.1" 200 None
2025-12-05 20:01:46 [manheim.gb] INFO: Scrape type for 2528639: 0
2025-12-05 20:01:46 [manheim.gb] INFO: Found listing with ID: 2542025
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272542025%27 HTTP/1.1" 200 None
2025-12-05 20:01:46 [manheim.gb] INFO: Scrape type for 2542025: 0
2025-12-05 20:01:46 [manheim.gb] INFO: Found listing with ID: 2544324
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272544324%27 HTTP/1.1" 200 None
2025-12-05 20:01:46 [manheim.gb] INFO: Scrape type for 2544324: 1
2025-12-05 20:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=1966868&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231966868&indx=66> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64335dd0>
2025-12-05 20:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_6.jpg saved to cache
2025-12-05 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 527bd38b-bb30-52cf-b049-0cd34e2be0bf
2025-12-05 20:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a717d04a-3a19-51c6-a28a-239999dea5de with identifier: 1773610
2025-12-05 20:01:46 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a717d04a-3a19-51c6-a28a-239999dea5de
2025-12-05 20:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e with identifier: 1926821
2025-12-05 20:01:46 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e
2025-12-05 20:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64185350>
2025-12-05 20:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_7.jpg saved to cache
2025-12-05 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 527bd38b-bb30-52cf-b049-0cd34e2be0bf
2025-12-05 20:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e51d250>
2025-12-05 20:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_7.jpg saved to cache
2025-12-05 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 527bd38b-bb30-52cf-b049-0cd34e2be0bf
2025-12-05 20:01:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 527bd38b-bb30-52cf-b049-0cd34e2be0bf, skipping ID generation
2025-12-05 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 527bd38b-bb30-52cf-b049-0cd34e2be0bf from tracking dictionaries
2025-12-05 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 527bd38b-bb30-52cf-b049-0cd34e2be0bf sending to next pipeline
2025-12-05 20:01:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 527bd38b-bb30-52cf-b049-0cd34e2be0bf, identifier: 1123228
2025-12-05 20:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:01:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 527bd38b-bb30-52cf-b049-0cd34e2be0bf with identifier: 1123228
2025-12-05 20:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 527bd38b-bb30-52cf-b049-0cd34e2be0bf with identifier: 1123228
2025-12-05 20:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 28, 'seller_name': 'stellantis & you', 'price_includes_vat': False, 'title': 'peugeot 208 1.2 puretech 82 active 5dr', 'price': 0, 'currency': 'gbp', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'engine': '1.2l', 'fuel_type': 'petrol', 'odometer': 132323, 'odometer_reading_unit': 'mi', 'registration_date': '2015-07-17', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/peugeot/208?id=1123228', 'location': 'leeds', 'origin_country_code': 'gb', 'trim': '1.2 puretech 82 active 5dr', 'license_plate': 'rf15hcy', 'year': 2015, 'listing': 'auction', 'c_o_2_emission_value': 104, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001123228-01987612-002.pdf', 'expiration_date': '2025-12-08t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '527bd38b-bb30-52cf-b049-0cd34e2be0bf', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_expert_report_file_7cdbab08-2b10-42a9-a46b-60fc28112b7e.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 208388}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 208388}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 240798}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 216822}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 140566}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 181100}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 169947}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 186321}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 203613}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 244081}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 221684}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 187252}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 205939}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 339989}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 354295}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 345316}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 263417}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 328011}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 295493}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 302699}], 'current_year_diff': 10, 'age_in_months': 124, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 212952}
Failed validating None in schema:
False
On instance:
{'age_in_months': 124,
'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_expert_report_file_7cdbab08-2b10-42a9-a46b-60fc28112b7e.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001123228-01987612-002.pdf',
'color': 'black',
'currency': 'gbp',
'current_year_diff': 10,
'engine': '1.2l',
'expiration_date': '2025-12-08t09:00:00z',
'fuel_type': 'petrol',
'id': '527bd38b-bb30-52cf-b049-0cd34e2be0bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'rf15hcy',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/peugeot/208?id=1123228',
'listing': 'auction',
'location': 'leeds',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 132323,
'odometer_in_km': 212952,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 208388,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 208388,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 240798,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216822,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 140566,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181100,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 169947,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186321,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 203613,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 244081,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 221684,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187252,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 205939,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339989,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354295,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345316,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263417,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328011,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295493,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302699,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-17',
'sanitized_make': 'peugeot',
'seller_name': 'stellantis & you',
'title': 'peugeot 208 1.2 puretech 82 active 5dr',
'transmission': 'manual',
'trim': '1.2 puretech 82 active 5dr',
'year': 2015}
2025-12-05 20:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 527bd38b-bb30-52cf-b049-0cd34e2be0bf spider: manheim.gb
2025-12-05 20:01:47 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 527bd38b-bb30-52cf-b049-0cd34e2be0bf due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 28, 'seller_name': 'stellantis & you', 'price_includes_vat': False, 'title': 'peugeot 208 1.2 puretech 82 active 5dr', 'price': 0, 'currency': 'gbp', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'engine': '1.2l', 'fuel_type': 'petrol', 'odometer': 132323, 'odometer_reading_unit': 'mi', 'registration_date': '2015-07-17', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/peugeot/208?id=1123228', 'location': 'leeds', 'origin_country_code': 'gb', 'trim': '1.2 puretech 82 active 5dr', 'license_plate': 'rf15hcy', 'year': 2015, 'listing': 'auction', 'c_o_2_emission_value': 104, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001123228-01987612-002.pdf', 'expiration_date': '2025-12-08t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '527bd38b-bb30-52cf-b049-0cd34e2be0bf', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_expert_report_file_7cdbab08-2b10-42a9-a46b-60fc28112b7e.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 208388}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 208388}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 240798}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 216822}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 140566}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 181100}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 169947}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 186321}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 203613}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 244081}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 221684}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 187252}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 205939}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 339989}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 354295}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 345316}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 263417}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 328011}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 295493}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 302699}], 'current_year_diff': 10, 'age_in_months': 124, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 212952}
Failed validating None in schema:
False
On instance:
{'age_in_months': 124,
'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_expert_report_file_7cdbab08-2b10-42a9-a46b-60fc28112b7e.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001123228-01987612-002.pdf',
'color': 'black',
'currency': 'gbp',
'current_year_diff': 10,
'engine': '1.2l',
'expiration_date': '2025-12-08t09:00:00z',
'fuel_type': 'petrol',
'id': '527bd38b-bb30-52cf-b049-0cd34e2be0bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'rf15hcy',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/peugeot/208?id=1123228',
'listing': 'auction',
'location': 'leeds',
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 132323,
'odometer_in_km': 212952,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 208388,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 208388,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 240798,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216822,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 140566,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181100,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 169947,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186321,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 203613,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 244081,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 221684,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187252,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 205939,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339989,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354295,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345316,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263417,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328011,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295493,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302699,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-17',
'sanitized_make': 'peugeot',
'seller_name': 'stellantis & you',
'title': 'peugeot 208 1.2 puretech 82 active 5dr',
'transmission': 'manual',
'trim': '1.2 puretech 82 active 5dr',
'year': 2015}
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_expert_report_file_7cdbab08-2b10-42a9-a46b-60fc28112b7e.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001123228-01987612-002.pdf',
'color': 'BLACK',
'currency': 'GBP',
'engine': '1.2L',
'expiration_date': '2025-12-08T09:00:00Z',
'fuel_type': 'Petrol',
'id': '527bd38b-bb30-52cf-b049-0cd34e2be0bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RF15HCY',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/208?id=1123228',
'listing': 'auction',
'location': 'Leeds',
'make': 'PEUGEOT',
'model': '208',
'odometer': 132323,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 208388,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 208388,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 240798,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216822,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 140566,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181100,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 169947,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186321,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 203613,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 244081,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 221684,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187252,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 205939,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3d4a2641-8871-481a-9f78-5fdbfd95a0d9_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339989,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354295,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345316,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263417,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328011,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295493,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_527bd38b-bb30-52cf-b049-0cd34e2be0bf/527bd38b-bb30-52cf-b049-0cd34e2be0bf_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302699,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1123228-4009786-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-17',
'seller_name': 'Stellantis & You',
'title': 'PEUGEOT 208 1.2 PureTech 82 Active 5dr',
'transmission': 'manual',
'trim': '1.2 PureTech 82 Active 5dr',
'year': 2015}
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271123228%27 HTTP/1.1" 200 None
2025-12-05 20:01:47 [manheim.gb] INFO: Saving data for 1123228: {'created_time': 1764964907.82973, 'last_price_update_time': 1764964907.829742, 'auction_closing_time': 1765184400.0}
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1123228') HTTP/1.1" 204 0
2025-12-05 20:01:47 [manheim.gb] INFO: Found listing with ID: 2550099
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272550099%27 HTTP/1.1" 200 None
2025-12-05 20:01:47 [manheim.gb] INFO: Scrape type for 2550099: 0
2025-12-05 20:01:47 [manheim.gb] INFO: Found listing with ID: 2550798
2025-12-05 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272550798%27 HTTP/1.1" 200 None
2025-12-05 20:01:48 [manheim.gb] INFO: Scrape type for 2550798: 0
2025-12-05 20:01:48 [manheim.gb] INFO: Found listing with ID: 255681
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27255681%27 HTTP/1.1" 200 None
2025-12-05 20:01:48 [manheim.gb] INFO: Scrape type for 255681: 0
2025-12-05 20:01:48 [manheim.gb] INFO: Found listing with ID: 2561807
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272561807%27 HTTP/1.1" 200 None
2025-12-05 20:01:48 [manheim.gb] INFO: Scrape type for 2561807: 0
2025-12-05 20:01:48 [manheim.gb] INFO: Found listing with ID: 2562472
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272562472%27 HTTP/1.1" 200 None
2025-12-05 20:01:48 [manheim.gb] INFO: Scrape type for 2562472: 0
2025-12-05 20:01:48 [manheim.gb] INFO: Found listing with ID: 2577653
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272577653%27 HTTP/1.1" 200 None
2025-12-05 20:01:48 [manheim.gb] INFO: Scrape type for 2577653: 0
2025-12-05 20:01:48 [manheim.gb] INFO: Found listing with ID: 2585181
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272585181%27 HTTP/1.1" 200 None
2025-12-05 20:01:48 [manheim.gb] INFO: Scrape type for 2585181: 0
2025-12-05 20:01:48 [manheim.gb] INFO: Found listing with ID: 2589156
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272589156%27 HTTP/1.1" 200 None
2025-12-05 20:01:48 [manheim.gb] INFO: Scrape type for 2589156: 0
2025-12-05 20:01:48 [manheim.gb] INFO: Found listing with ID: 2590049
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272590049%27 HTTP/1.1" 200 None
2025-12-05 20:01:48 [manheim.gb] INFO: Scrape type for 2590049: 0
2025-12-05 20:01:48 [manheim.gb] INFO: Found listing with ID: 2597131
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272597131%27 HTTP/1.1" 200 None
2025-12-05 20:01:48 [manheim.gb] INFO: Scrape type for 2597131: 1
2025-12-05 20:01:48 [manheim.gb] INFO: Found listing with ID: 2599853
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272599853%27 HTTP/1.1" 200 None
2025-12-05 20:01:48 [manheim.gb] INFO: Scrape type for 2599853: 1
2025-12-05 20:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 941069ff-ef30-5bba-82bd-388d3cb54f16 with identifier: 1966868
2025-12-05 20:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 941069ff-ef30-5bba-82bd-388d3cb54f16 with scrape type 2
2025-12-05 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 941069ff-ef30-5bba-82bd-388d3cb54f16 with scrape type 2
2025-12-05 20:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 941069ff-ef30-5bba-82bd-388d3cb54f16, identifier: 1966868
2025-12-05 20:01:48 [manheim.gb] INFO: Found listing with ID: 2606673
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272606673%27 HTTP/1.1" 200 None
2025-12-05 20:01:48 [manheim.gb] INFO: Scrape type for 2606673: 2
2025-12-05 20:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 941069ff-ef30-5bba-82bd-388d3cb54f16 with identifier: 1966868
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLUE HTTP/1.1" 200 None
2025-12-05 20:01:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 941069ff-ef30-5bba-82bd-388d3cb54f16 with identifier: 1966868
2025-12-05 20:01:48 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 941069ff-ef30-5bba-82bd-388d3cb54f16 with identifier: 1966868 to the API
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:01:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=1966868&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231966868&indx=66>
{'auction_title': '',
'c_o_2_emission_value': 103,
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001966868-01991002-002.pdf',
'color': 'BLUE',
'currency': 'GBP',
'engine': '1.5L',
'expiration_date': '2025-12-08T09:00:00Z',
'fuel_type': 'Diesel',
'id': '941069ff-ef30-5bba-82bd-388d3cb54f16',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BN16GEK',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=1966868',
'listing': 'auction',
'location': 'Leeds',
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 71346,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-04',
'seller_name': 'Big Motoring World Ltd',
'title': 'NISSAN QASHQAI 1.5 dCi Tekna [Non-Panoramic] 5dr',
'transmission': 'manual',
'trim': '1.5 dCi Tekna [Non-Panoramic] 5dr',
'year': 2016}
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271966868%27 HTTP/1.1" 200 None
2025-12-05 20:01:48 [manheim.gb] INFO: Saving data for 1966868: {'auction_closing_time': 1765184400.0, 'created_time': 1764842893.866226, 'last_price_update_time': 1764964908.792084}
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1966868') HTTP/1.1" 204 0
2025-12-05 20:01:48 [manheim.gb] INFO: Found listing with ID: 2609231
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272609231%27 HTTP/1.1" 200 None
2025-12-05 20:01:48 [manheim.gb] INFO: Scrape type for 2609231: 0
2025-12-05 20:01:48 [manheim.gb] INFO: Found listing with ID: 2612688
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272612688%27 HTTP/1.1" 200 None
2025-12-05 20:01:48 [manheim.gb] INFO: Scrape type for 2612688: 0
2025-12-05 20:01:48 [manheim.gb] INFO: Found listing with ID: 2636985
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272636985%27 HTTP/1.1" 200 None
2025-12-05 20:01:48 [manheim.gb] INFO: Scrape type for 2636985: 1
2025-12-05 20:01:48 [manheim.gb] INFO: Found listing with ID: 2652071
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272652071%27 HTTP/1.1" 200 None
2025-12-05 20:01:48 [manheim.gb] INFO: Scrape type for 2652071: 0
2025-12-05 20:01:48 [manheim.gb] INFO: Found listing with ID: 2654910
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272654910%27 HTTP/1.1" 200 None
2025-12-05 20:01:48 [manheim.gb] INFO: Scrape type for 2654910: 0
2025-12-05 20:01:48 [manheim.gb] INFO: Found listing with ID: 2660446
2025-12-05 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272660446%27 HTTP/1.1" 200 None
2025-12-05 20:01:49 [manheim.gb] INFO: Scrape type for 2660446: 0
2025-12-05 20:01:49 [manheim.gb] INFO: Found listing with ID: 2664010
2025-12-05 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272664010%27 HTTP/1.1" 200 None
2025-12-05 20:01:49 [manheim.gb] INFO: Scrape type for 2664010: 0
2025-12-05 20:01:49 [manheim.gb] INFO: Found listing with ID: 2688065
2025-12-05 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272688065%27 HTTP/1.1" 200 None
2025-12-05 20:01:49 [manheim.gb] INFO: Scrape type for 2688065: 2
2025-12-05 20:01:49 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
scraped_item = self._extract_listing_item(item, expiration_date)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
item["odometer"] = odometer
~~~~^^^^^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-05 20:01:49 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
scraped_item = self._extract_listing_item(item, expiration_date)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
item["odometer"] = odometer
~~~~^^^^^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-05 20:01:49 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
scraped_item = self._extract_listing_item(item, expiration_date)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
item["odometer"] = odometer
~~~~^^^^^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-05 20:01:49 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
scraped_item = self._extract_listing_item(item, expiration_date)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
item["odometer"] = odometer
~~~~^^^^^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-05 20:01:49 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
scraped_item = self._extract_listing_item(item, expiration_date)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
item["odometer"] = odometer
~~~~^^^^^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-05 20:01:49 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
scraped_item = self._extract_listing_item(item, expiration_date)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
item["odometer"] = odometer
~~~~^^^^^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-05 20:01:49 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
scraped_item = self._extract_listing_item(item, expiration_date)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
item["odometer"] = odometer
~~~~^^^^^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-05 20:01:49 [scrapy.core.scraper] ERROR: Spider error processing <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search)
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 295, in aiter_errback
yield await it.__anext__()
^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
return await self.data.__anext__()
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
async for o in as_async_generator(it):
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
async for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
return await self.data.__anext__()
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
async for o in as_async_generator(it):
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
async for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/_middlewares.py", line 206, in process_spider_output_async
async for item_or_request in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
scraped_item = self._extract_listing_item(item, expiration_date)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
item["odometer"] = odometer
~~~~^^^^^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-05 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001589816-01994458-002.pdf> (referer: None)
2025-12-05 20:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fb72210>
2025-12-05 20:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_expert_report_file_7ad26f4c-7b55-48fc-8ccc-fe971b3937f0.pdf HTTP/1.1" 201 0
2025-12-05 20:01:50 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 652cbaa6-caba-53bf-9524-0d49c3ca865e
2025-12-05 20:01:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 652cbaa6-caba-53bf-9524-0d49c3ca865e, skipping ID generation
2025-12-05 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 652cbaa6-caba-53bf-9524-0d49c3ca865e
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_7.jpg not downloaded yet
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_7.jpg not downloaded yet
2025-12-05 20:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001773610-01989969-002.pdf> (referer: None)
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_6.jpg not downloaded yet
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_1.jpg not downloaded yet
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_5.jpg not downloaded yet
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_4.jpg not downloaded yet
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_11.jpg not downloaded yet
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_10.jpg not downloaded yet
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_9.jpg not downloaded yet
2025-12-05 20:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001512515-01985662-002.pdf> (referer: None)
2025-12-05 20:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fb8cfd0>
2025-12-05 20:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_expert_report_file_630e7c6c-8603-4480-b26d-ec8331eb1b3e.pdf HTTP/1.1" 201 0
2025-12-05 20:01:50 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a717d04a-3a19-51c6-a28a-239999dea5de
2025-12-05 20:01:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a717d04a-3a19-51c6-a28a-239999dea5de, skipping ID generation
2025-12-05 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item a717d04a-3a19-51c6-a28a-239999dea5de
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdb8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_7.jpg not downloaded yet
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_2.jpg not downloaded yet
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdb8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_7.jpg not downloaded yet
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_5.jpg not downloaded yet
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdb8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_6.jpg not downloaded yet
2025-12-05 20:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc644e4f90>
2025-12-05 20:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_expert_report_file_a45d0587-3363-41b8-9468-c491caa928a6.pdf HTTP/1.1" 201 0
2025-12-05 20:01:51 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ece1f6a2-0b48-5604-adc2-850b2ea40751
2025-12-05 20:01:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ece1f6a2-0b48-5604-adc2-850b2ea40751, skipping ID generation
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item ece1f6a2-0b48-5604-adc2-850b2ea40751
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_7.jpg not downloaded yet
2025-12-05 20:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001589816-01994458-002.pdf)
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_3.jpg not downloaded yet
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdb8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_1.jpg not downloaded yet
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_7.jpg not downloaded yet
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_4.jpg not downloaded yet
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdb8422e7-be6b-4a10-ae13-e0090ac9d1e3_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_5.jpg not downloaded yet
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_6.jpg not downloaded yet
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1589816-4010316-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1589816-4010316-13.jpg not downloaded yet
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdb8422e7-be6b-4a10-ae13-e0090ac9d1e3_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_4.jpg not downloaded yet
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_1.jpg not downloaded yet
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1589816-4010316-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1589816-4010316-1000.jpg not downloaded yet
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdb8422e7-be6b-4a10-ae13-e0090ac9d1e3_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_11.jpg not downloaded yet
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F426a1c40-f5b2-4785-9e43-015a8abc23ea_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_5.jpg not downloaded yet
2025-12-05 20:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6448c190>
2025-12-05 20:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_7.jpg saved to cache
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 652cbaa6-caba-53bf-9524-0d49c3ca865e
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1589816-4010316-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1589816-4010316-1001.jpg not downloaded yet
2025-12-05 20:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001926821-01989972-005.pdf> (referer: None)
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdb8422e7-be6b-4a10-ae13-e0090ac9d1e3_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_10.jpg not downloaded yet
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F426a1c40-f5b2-4785-9e43-015a8abc23ea_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_4.jpg not downloaded yet
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1589816-4010316-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1589816-4010316-1002.jpg not downloaded yet
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdb8422e7-be6b-4a10-ae13-e0090ac9d1e3_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_9.jpg not downloaded yet
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F426a1c40-f5b2-4785-9e43-015a8abc23ea_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_11.jpg not downloaded yet
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1589816-4010316-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1589816-4010316-1003.jpg not downloaded yet
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdb8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_2.jpg not downloaded yet
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F426a1c40-f5b2-4785-9e43-015a8abc23ea_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_10.jpg not downloaded yet
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1589816-4010316-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1589816-4010316-1004.jpg not downloaded yet
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdb8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_5.jpg not downloaded yet
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F426a1c40-f5b2-4785-9e43-015a8abc23ea_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_9.jpg not downloaded yet
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1589816-4010316-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1589816-4010316-1005.jpg not downloaded yet
2025-12-05 20:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6448f610>
2025-12-05 20:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_expert_report_file_03d359d9-6125-4692-9fbe-f2370bb6092f.pdf HTTP/1.1" 201 0
2025-12-05 20:01:52 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e
2025-12-05 20:01:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e, skipping ID generation
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F46cf8f30-a853-4a65-8193-6795208130ba_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_7.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdb8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_3.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_2.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F46cf8f30-a853-4a65-8193-6795208130ba_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_7.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdb8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_4.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_5.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F46cf8f30-a853-4a65-8193-6795208130ba_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_6.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1773610-4005797-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1773610-4005797-13.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_3.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F46cf8f30-a853-4a65-8193-6795208130ba_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_1.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1773610-4005797-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1773610-4005797-1000.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_4.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F46cf8f30-a853-4a65-8193-6795208130ba_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_5.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1773610-4005797-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1773610-4005797-1001.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1512515-4009920-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1512515-4009920-13.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F46cf8f30-a853-4a65-8193-6795208130ba_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_4.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1773610-4005797-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1773610-4005797-1002.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1512515-4009920-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1512515-4009920-1000.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F46cf8f30-a853-4a65-8193-6795208130ba_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_11.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1773610-4005797-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1773610-4005797-1003.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1512515-4009920-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1512515-4009920-1001.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F46cf8f30-a853-4a65-8193-6795208130ba_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_10.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1773610-4005797-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1773610-4005797-1004.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1512515-4009920-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1512515-4009920-1002.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F46cf8f30-a853-4a65-8193-6795208130ba_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_9.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1773610-4005797-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1773610-4005797-1005.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1512515-4009920-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1512515-4009920-1003.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F46cf8f30-a853-4a65-8193-6795208130ba_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_2.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1512515-4009920-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1512515-4009920-1004.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F46cf8f30-a853-4a65-8193-6795208130ba_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_5.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1512515-4009920-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1512515-4009920-1005.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F46cf8f30-a853-4a65-8193-6795208130ba_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_3.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F46cf8f30-a853-4a65-8193-6795208130ba_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_4.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1926821-4005470-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1926821-4005470-13.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1926821-4005470-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1926821-4005470-1000.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1926821-4005470-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1926821-4005470-1001.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1926821-4005470-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1926821-4005470-1002.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1926821-4005470-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1926821-4005470-1003.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1926821-4005470-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1926821-4005470-1004.jpg not downloaded yet
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1926821-4005470-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1926821-4005470-1005.jpg not downloaded yet
2025-12-05 20:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001926821-01989972-005.pdf)
2025-12-05 20:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1512515-4009920-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001512515-01985662-002.pdf)
2025-12-05 20:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001926821-01989972-005.pdf)
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6403f750>
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F46cf8f30-a853-4a65-8193-6795208130ba_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_4.jpg saved to cache
2025-12-05 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f23f050>
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_19.jpg HTTP/1.1" 201 0
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1512515-4009920-1005.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1512515-4009920-1005.jpg saved to cache
2025-12-05 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item ece1f6a2-0b48-5604-adc2-850b2ea40751
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc65a03350>
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F46cf8f30-a853-4a65-8193-6795208130ba_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_3.jpg saved to cache
2025-12-05 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e
2025-12-05 20:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1926821-4005470-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001926821-01989972-005.pdf)
2025-12-05 20:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1926821-4005470-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001926821-01989972-005.pdf)
2025-12-05 20:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1926821-4005470-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001926821-01989972-005.pdf)
2025-12-05 20:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6403ef90>
2025-12-05 20:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_19.jpg HTTP/1.1" 201 0
2025-12-05 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1926821-4005470-1005.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1926821-4005470-1005.jpg saved to cache
2025-12-05 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e
2025-12-05 20:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64336950>
2025-12-05 20:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_18.jpg HTTP/1.1" 201 0
2025-12-05 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1926821-4005470-1004.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1926821-4005470-1004.jpg saved to cache
2025-12-05 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e
2025-12-05 20:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fb8f310>
2025-12-05 20:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_17.jpg HTTP/1.1" 201 0
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1926821-4005470-1003.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1926821-4005470-1003.jpg saved to cache
2025-12-05 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e
2025-12-05 20:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1926821-4005470-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001926821-01989972-005.pdf)
2025-12-05 20:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1926821-4005470-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001926821-01989972-005.pdf)
2025-12-05 20:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1926821-4005470-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001926821-01989972-005.pdf)
2025-12-05 20:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640a1110>
2025-12-05 20:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_16.jpg HTTP/1.1" 201 0
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1926821-4005470-1002.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1926821-4005470-1002.jpg saved to cache
2025-12-05 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e
2025-12-05 20:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640a0210>
2025-12-05 20:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_15.jpg HTTP/1.1" 201 0
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1926821-4005470-1001.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1926821-4005470-1001.jpg saved to cache
2025-12-05 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e
2025-12-05 20:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc643eeb90>
2025-12-05 20:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1926821-4005470-1000.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1926821-4005470-1000.jpg saved to cache
2025-12-05 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e
2025-12-05 20:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001926821-01989972-005.pdf)
2025-12-05 20:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1926821-4005470-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001926821-01989972-005.pdf)
2025-12-05 20:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1512515-4009920-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001512515-01985662-002.pdf)
2025-12-05 20:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc644af810>
2025-12-05 20:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F46cf8f30-a853-4a65-8193-6795208130ba_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_5.jpg saved to cache
2025-12-05 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e
2025-12-05 20:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6450ac50>
2025-12-05 20:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1926821-4005470-13.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1926821-4005470-13.jpg saved to cache
2025-12-05 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e
2025-12-05 20:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc641647d0>
2025-12-05 20:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_18.jpg HTTP/1.1" 201 0
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1512515-4009920-1004.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1512515-4009920-1004.jpg saved to cache
2025-12-05 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item ece1f6a2-0b48-5604-adc2-850b2ea40751
2025-12-05 20:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001926821-01989972-005.pdf)
2025-12-05 20:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1773610-4005797-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001773610-01989969-002.pdf)
2025-12-05 20:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1512515-4009920-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001512515-01985662-002.pdf)
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e528e50>
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F46cf8f30-a853-4a65-8193-6795208130ba_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_2.jpg saved to cache
2025-12-05 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640a2490>
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_19.jpg HTTP/1.1" 201 0
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1773610-4005797-1005.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1773610-4005797-1005.jpg saved to cache
2025-12-05 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item a717d04a-3a19-51c6-a28a-239999dea5de
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6436e050>
2025-12-05 20:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_17.jpg HTTP/1.1" 201 0
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1512515-4009920-1003.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1512515-4009920-1003.jpg saved to cache
2025-12-05 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item ece1f6a2-0b48-5604-adc2-850b2ea40751
2025-12-05 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001926821-01989972-005.pdf)
2025-12-05 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1773610-4005797-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001773610-01989969-002.pdf)
2025-12-05 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1512515-4009920-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001512515-01985662-002.pdf)
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6450a210>
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F46cf8f30-a853-4a65-8193-6795208130ba_9.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_9.jpg saved to cache
2025-12-05 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e
2025-12-05 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001926821-01989972-005.pdf)
2025-12-05 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1773610-4005797-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001773610-01989969-002.pdf)
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fbf3290>
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_18.jpg HTTP/1.1" 201 0
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1773610-4005797-1004.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1773610-4005797-1004.jpg saved to cache
2025-12-05 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item a717d04a-3a19-51c6-a28a-239999dea5de
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640b7390>
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_16.jpg HTTP/1.1" 201 0
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1512515-4009920-1002.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1512515-4009920-1002.jpg saved to cache
2025-12-05 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item ece1f6a2-0b48-5604-adc2-850b2ea40751
2025-12-05 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1512515-4009920-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001512515-01985662-002.pdf)
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2cc390>
2025-12-05 20:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F46cf8f30-a853-4a65-8193-6795208130ba_10.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_10.jpg saved to cache
2025-12-05 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e
2025-12-05 20:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc644a39d0>
2025-12-05 20:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_17.jpg HTTP/1.1" 201 0
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1773610-4005797-1003.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1773610-4005797-1003.jpg saved to cache
2025-12-05 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item a717d04a-3a19-51c6-a28a-239999dea5de
2025-12-05 20:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001926821-01989972-005.pdf)
2025-12-05 20:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1773610-4005797-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001773610-01989969-002.pdf)
2025-12-05 20:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6443f050>
2025-12-05 20:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_15.jpg HTTP/1.1" 201 0
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1512515-4009920-1001.jpg') HTTP/1.1" 204 0
2025-12-05 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1512515-4009920-1001.jpg saved to cache
2025-12-05 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item ece1f6a2-0b48-5604-adc2-850b2ea40751
2025-12-05 20:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1512515-4009920-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001512515-01985662-002.pdf)
2025-12-05 20:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f249090>
2025-12-05 20:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F46cf8f30-a853-4a65-8193-6795208130ba_11.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_11.jpg saved to cache
2025-12-05 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e
2025-12-05 20:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6435ccd0>
2025-12-05 20:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_16.jpg HTTP/1.1" 201 0
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1773610-4005797-1002.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1773610-4005797-1002.jpg saved to cache
2025-12-05 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item a717d04a-3a19-51c6-a28a-239999dea5de
2025-12-05 20:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001926821-01989972-005.pdf)
2025-12-05 20:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1773610-4005797-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001773610-01989969-002.pdf)
2025-12-05 20:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6408b6d0>
2025-12-05 20:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1512515-4009920-1000.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1512515-4009920-1000.jpg saved to cache
2025-12-05 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item ece1f6a2-0b48-5604-adc2-850b2ea40751
2025-12-05 20:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1512515-4009920-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001512515-01985662-002.pdf)
2025-12-05 20:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2d4ed0>
2025-12-05 20:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F46cf8f30-a853-4a65-8193-6795208130ba_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_4.jpg saved to cache
2025-12-05 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e
2025-12-05 20:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64619ad0>
2025-12-05 20:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_15.jpg HTTP/1.1" 201 0
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1773610-4005797-1001.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1773610-4005797-1001.jpg saved to cache
2025-12-05 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item a717d04a-3a19-51c6-a28a-239999dea5de
2025-12-05 20:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001926821-01989972-005.pdf)
2025-12-05 20:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001512515-01985662-002.pdf)
2025-12-05 20:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6408aa90>
2025-12-05 20:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1512515-4009920-13.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1512515-4009920-13.jpg saved to cache
2025-12-05 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ece1f6a2-0b48-5604-adc2-850b2ea40751
2025-12-05 20:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1773610-4005797-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001773610-01989969-002.pdf)
2025-12-05 20:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6435ee10>
2025-12-05 20:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F46cf8f30-a853-4a65-8193-6795208130ba_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_5.jpg saved to cache
2025-12-05 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e
2025-12-05 20:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc641bb7d0>
2025-12-05 20:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_4.jpg saved to cache
2025-12-05 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ece1f6a2-0b48-5604-adc2-850b2ea40751
2025-12-05 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001512515-01985662-002.pdf)
2025-12-05 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001926821-01989972-005.pdf)
2025-12-05 20:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fb97710>
2025-12-05 20:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1773610-4005797-1000.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1773610-4005797-1000.jpg saved to cache
2025-12-05 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a717d04a-3a19-51c6-a28a-239999dea5de
2025-12-05 20:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6445a2d0>
2025-12-05 20:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_3.jpg saved to cache
2025-12-05 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ece1f6a2-0b48-5604-adc2-850b2ea40751
2025-12-05 20:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2fadd0>
2025-12-05 20:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F46cf8f30-a853-4a65-8193-6795208130ba_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_1.jpg saved to cache
2025-12-05 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e
2025-12-05 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1773610-4005797-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001773610-01989969-002.pdf)
2025-12-05 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001512515-01985662-002.pdf)
2025-12-05 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001926821-01989972-005.pdf)
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e52b050>
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1773610-4005797-13.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1773610-4005797-13.jpg saved to cache
2025-12-05 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a717d04a-3a19-51c6-a28a-239999dea5de
2025-12-05 20:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001926821-01989972-005.pdf)
2025-12-05 20:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001512515-01985662-002.pdf)
2025-12-05 20:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001773610-01989969-002.pdf)
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e535f50>
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_5.jpg saved to cache
2025-12-05 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ece1f6a2-0b48-5604-adc2-850b2ea40751
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e51ca50>
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F46cf8f30-a853-4a65-8193-6795208130ba_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_6.jpg saved to cache
2025-12-05 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64185bd0>
2025-12-05 20:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F46cf8f30-a853-4a65-8193-6795208130ba_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_7.jpg saved to cache
2025-12-05 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e
2025-12-05 20:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc644da210>
2025-12-05 20:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_2.jpg saved to cache
2025-12-05 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ece1f6a2-0b48-5604-adc2-850b2ea40751
2025-12-05 20:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc641e6f10>
2025-12-05 20:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdb8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_4.jpg saved to cache
2025-12-05 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a717d04a-3a19-51c6-a28a-239999dea5de
2025-12-05 20:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1589816-4010316-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001589816-01994458-002.pdf)
2025-12-05 20:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001926821-01989972-005.pdf)
2025-12-05 20:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001773610-01989969-002.pdf)
2025-12-05 20:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fbc2f10>
2025-12-05 20:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_19.jpg HTTP/1.1" 201 0
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1589816-4010316-1005.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1589816-4010316-1005.jpg saved to cache
2025-12-05 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 652cbaa6-caba-53bf-9524-0d49c3ca865e
2025-12-05 20:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2ced10>
2025-12-05 20:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F46cf8f30-a853-4a65-8193-6795208130ba_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_7.jpg saved to cache
2025-12-05 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e
2025-12-05 20:02:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e, skipping ID generation
2025-12-05 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e from tracking dictionaries
2025-12-05 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e sending to next pipeline
2025-12-05 20:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e, identifier: 1926821
2025-12-05 20:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc66807590>
2025-12-05 20:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdb8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_3.jpg saved to cache
2025-12-05 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a717d04a-3a19-51c6-a28a-239999dea5de
2025-12-05 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001512515-01985662-002.pdf)
2025-12-05 20:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e with identifier: 1926821
2025-12-05 20:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e with identifier: 1926821
2025-12-05 20:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e with identifier: 1926821 to the API
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_expert_report_file_03d359d9-6125-4692-9fbe-f2370bb6092f.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001926821-01989972-005.pdf',
'color': 'BLUE',
'currency': 'GBP',
'engine': '1.4L',
'expiration_date': '2025-12-09T09:00:00Z',
'fuel_type': 'Petrol',
'id': 'f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VX16JVD',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/ASTRA?id=1926821',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 68715,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 33,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189124,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189124,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 238674,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 211361,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186388,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187398,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 190755,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181736,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 190473,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260434,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188079,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 247109,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 163121,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/46cf8f30-a853-4a65-8193-6795208130ba_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253165,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1926821-4005470-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362647,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1926821-4005470-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324283,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1926821-4005470-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 274495,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1926821-4005470-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355977,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1926821-4005470-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375683,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1926821-4005470-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e/f099fa4d-8169-56f4-b0ee-bd3e4fcd6a8e_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283510,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1926821-4005470-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-11',
'seller_name': 'NextGear Capital UK Ltd',
'title': 'VAUXHALL ASTRA 1.4i 16V SRi 5dr',
'transmission': 'manual',
'trim': '1.4i 16V SRi 5dr',
'year': 2016}
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271926821%27 HTTP/1.1" 200 None
2025-12-05 20:02:06 [manheim.gb] INFO: Saving data for 1926821: {'created_time': 1764964926.618132, 'last_price_update_time': 1764964926.618144, 'auction_closing_time': 1765270800.0}
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1926821') HTTP/1.1" 204 0
2025-12-05 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001773610-01989969-002.pdf)
2025-12-05 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=233754&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%23233754&indx=98> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1589816-4010316-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001589816-01994458-002.pdf)
2025-12-05 20:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fbf2210>
2025-12-05 20:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F426a1c40-f5b2-4785-9e43-015a8abc23ea_9.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_9.jpg saved to cache
2025-12-05 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ece1f6a2-0b48-5604-adc2-850b2ea40751
2025-12-05 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001512515-01985662-002.pdf)
2025-12-05 20:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64166e90>
2025-12-05 20:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdb8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_5.jpg saved to cache
2025-12-05 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a717d04a-3a19-51c6-a28a-239999dea5de
2025-12-05 20:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d428e59-cadd-5753-a5bf-34918c220e1e with identifier: 233754
2025-12-05 20:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d428e59-cadd-5753-a5bf-34918c220e1e with scrape type 2
2025-12-05 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d428e59-cadd-5753-a5bf-34918c220e1e with scrape type 2
2025-12-05 20:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 8d428e59-cadd-5753-a5bf-34918c220e1e, identifier: 233754
2025-12-05 20:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fb8ecd0>
2025-12-05 20:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_18.jpg HTTP/1.1" 201 0
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1589816-4010316-1004.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1589816-4010316-1004.jpg saved to cache
2025-12-05 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 652cbaa6-caba-53bf-9524-0d49c3ca865e
2025-12-05 20:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 8d428e59-cadd-5753-a5bf-34918c220e1e with identifier: 233754
2025-12-05 20:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 8d428e59-cadd-5753-a5bf-34918c220e1e with identifier: 233754
2025-12-05 20:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 12 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
12
2025-12-05 20:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 8d428e59-cadd-5753-a5bf-34918c220e1e spider: manheim.gb
2025-12-05 20:02:07 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 8d428e59-cadd-5753-a5bf-34918c220e1e due to rule: registration_date_old.json, error: 12 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
12
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0000233754-01989638-002.pdf',
'color': 'WHITE',
'currency': 'GBP',
'engine': '1.6L',
'expiration_date': '2025-12-09T09:00:00Z',
'fuel_type': 'Diesel',
'id': '8d428e59-cadd-5753-a5bf-34918c220e1e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EU63YRP',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=233754',
'listing': 'auction',
'location': 'Shotts',
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 92199,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-12',
'seller_name': 'Parks Motor Group',
'title': 'NISSAN QASHQAI 1.6 dCi 360 5dr [Start Stop]',
'transmission': 'manual',
'trim': '1.6 dCi 360 5dr [Start Stop]',
'year': 2013}
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27233754%27 HTTP/1.1" 200 None
2025-12-05 20:02:07 [manheim.gb] INFO: Saving data for 233754: {'auction_closing_time': 1765270800.0, 'created_time': 1764842967.747917, 'last_price_update_time': 1764964927.838344}
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='233754') HTTP/1.1" 204 0
2025-12-05 20:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001773610-01989969-002.pdf)
2025-12-05 20:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001512515-01985662-002.pdf)
2025-12-05 20:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001773610-01989969-002.pdf)
2025-12-05 20:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2aa750>
2025-12-05 20:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F426a1c40-f5b2-4785-9e43-015a8abc23ea_10.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_10.jpg saved to cache
2025-12-05 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ece1f6a2-0b48-5604-adc2-850b2ea40751
2025-12-05 20:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1589816-4010316-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001589816-01994458-002.pdf)
2025-12-05 20:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64411c50>
2025-12-05 20:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdb8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_2.jpg saved to cache
2025-12-05 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a717d04a-3a19-51c6-a28a-239999dea5de
2025-12-05 20:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e528490>
2025-12-05 20:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F426a1c40-f5b2-4785-9e43-015a8abc23ea_11.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_11.jpg saved to cache
2025-12-05 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ece1f6a2-0b48-5604-adc2-850b2ea40751
2025-12-05 20:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64089b50>
2025-12-05 20:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdb8422e7-be6b-4a10-ae13-e0090ac9d1e3_9.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_9.jpg saved to cache
2025-12-05 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a717d04a-3a19-51c6-a28a-239999dea5de
2025-12-05 20:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6448d4d0>
2025-12-05 20:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_17.jpg HTTP/1.1" 201 0
2025-12-05 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1589816-4010316-1003.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1589816-4010316-1003.jpg saved to cache
2025-12-05 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 652cbaa6-caba-53bf-9524-0d49c3ca865e
2025-12-05 20:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001512515-01985662-002.pdf)
2025-12-05 20:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001773610-01989969-002.pdf)
2025-12-05 20:02:09 [scrapy.extensions.logstats] INFO: Crawled 31 pages (at 25 pages/min), scraped 4 items (at 3 items/min)
2025-12-05 20:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1589816-4010316-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001589816-01994458-002.pdf)
2025-12-05 20:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1589816-4010316-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001589816-01994458-002.pdf)
2025-12-05 20:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64453f10>
2025-12-05 20:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F426a1c40-f5b2-4785-9e43-015a8abc23ea_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_4.jpg saved to cache
2025-12-05 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ece1f6a2-0b48-5604-adc2-850b2ea40751
2025-12-05 20:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64545e50>
2025-12-05 20:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdb8422e7-be6b-4a10-ae13-e0090ac9d1e3_10.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_10.jpg saved to cache
2025-12-05 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a717d04a-3a19-51c6-a28a-239999dea5de
2025-12-05 20:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001512515-01985662-002.pdf)
2025-12-05 20:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001512515-01985662-002.pdf)
2025-12-05 20:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001773610-01989969-002.pdf)
2025-12-05 20:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e51e050>
2025-12-05 20:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_16.jpg HTTP/1.1" 201 0
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1589816-4010316-1002.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1589816-4010316-1002.jpg saved to cache
2025-12-05 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 652cbaa6-caba-53bf-9524-0d49c3ca865e
2025-12-05 20:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6435cfd0>
2025-12-05 20:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_15.jpg HTTP/1.1" 201 0
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1589816-4010316-1001.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1589816-4010316-1001.jpg saved to cache
2025-12-05 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 652cbaa6-caba-53bf-9524-0d49c3ca865e
2025-12-05 20:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1589816-4010316-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001589816-01994458-002.pdf)
2025-12-05 20:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6436cdd0>
2025-12-05 20:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F426a1c40-f5b2-4785-9e43-015a8abc23ea_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_5.jpg saved to cache
2025-12-05 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ece1f6a2-0b48-5604-adc2-850b2ea40751
2025-12-05 20:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc641852d0>
2025-12-05 20:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_1.jpg saved to cache
2025-12-05 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ece1f6a2-0b48-5604-adc2-850b2ea40751
2025-12-05 20:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6450a210>
2025-12-05 20:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdb8422e7-be6b-4a10-ae13-e0090ac9d1e3_11.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_11.jpg saved to cache
2025-12-05 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a717d04a-3a19-51c6-a28a-239999dea5de
2025-12-05 20:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLVO/S90?id=2265358&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232265358&indx=90> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001773610-01989969-002.pdf)
2025-12-05 20:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001773610-01989969-002.pdf)
2025-12-05 20:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001512515-01985662-002.pdf)
2025-12-05 20:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640b5190>
2025-12-05 20:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1589816-4010316-1000.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1589816-4010316-1000.jpg saved to cache
2025-12-05 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 652cbaa6-caba-53bf-9524-0d49c3ca865e
2025-12-05 20:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1589816-4010316-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001589816-01994458-002.pdf)
2025-12-05 20:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b102101-564b-564d-8986-4da408ea4b0f with identifier: 2265358
2025-12-05 20:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b102101-564b-564d-8986-4da408ea4b0f with scrape type 2
2025-12-05 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b102101-564b-564d-8986-4da408ea4b0f with scrape type 2
2025-12-05 20:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 5b102101-564b-564d-8986-4da408ea4b0f, identifier: 2265358
2025-12-05 20:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2f9050>
2025-12-05 20:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdb8422e7-be6b-4a10-ae13-e0090ac9d1e3_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_4.jpg saved to cache
2025-12-05 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a717d04a-3a19-51c6-a28a-239999dea5de
2025-12-05 20:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc65a03310>
2025-12-05 20:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdb8422e7-be6b-4a10-ae13-e0090ac9d1e3_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_5.jpg saved to cache
2025-12-05 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a717d04a-3a19-51c6-a28a-239999dea5de
2025-12-05 20:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fbd5910>
2025-12-05 20:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_6.jpg saved to cache
2025-12-05 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ece1f6a2-0b48-5604-adc2-850b2ea40751
2025-12-05 20:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 5b102101-564b-564d-8986-4da408ea4b0f with identifier: 2265358
2025-12-05 20:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 5b102101-564b-564d-8986-4da408ea4b0f with identifier: 2265358
2025-12-05 20:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 5b102101-564b-564d-8986-4da408ea4b0f with identifier: 2265358 to the API
2025-12-05 20:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/VOLVO/S90?id=2265358&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232265358&indx=90>
{'auction_title': '',
'c_o_2_emission_value': 116,
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002265358-01990079-004.pdf',
'color': 'BLACK',
'currency': 'GBP',
'engine': '2.0L',
'expiration_date': '2025-12-09T09:00:00Z',
'fuel_type': 'Diesel',
'id': '5b102101-564b-564d-8986-4da408ea4b0f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GU67FWR',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLVO/S90?id=2265358',
'listing': 'auction',
'location': 'Northampton',
'make': 'VOLVO',
'model': 'S90',
'odometer': 87504,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-16',
'seller_name': 'Wollaston',
'title': 'VOLVO S90 2.0 D4 R DESIGN 4dr Geartronic',
'transmission': 'automatic',
'trim': '2.0 D4 R DESIGN 4dr Geartronic',
'year': 2018}
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272265358%27 HTTP/1.1" 200 None
2025-12-05 20:02:13 [manheim.gb] INFO: Saving data for 2265358: {'auction_closing_time': 1765270800.0, 'created_time': 1764842942.363026, 'last_price_update_time': 1764964933.103672}
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2265358') HTTP/1.1" 204 0
2025-12-05 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001589816-01994458-002.pdf)
2025-12-05 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001773610-01989969-002.pdf)
2025-12-05 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001589816-01994458-002.pdf)
2025-12-05 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001512515-01985662-002.pdf)
2025-12-05 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001512515-01985662-002.pdf)
2025-12-05 20:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc644ffd90>
2025-12-05 20:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1589816-4010316-13.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1589816-4010316-13.jpg saved to cache
2025-12-05 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 652cbaa6-caba-53bf-9524-0d49c3ca865e
2025-12-05 20:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2b5950>
2025-12-05 20:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_3.jpg saved to cache
2025-12-05 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 652cbaa6-caba-53bf-9524-0d49c3ca865e
2025-12-05 20:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6446f910>
2025-12-05 20:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdb8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_1.jpg saved to cache
2025-12-05 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a717d04a-3a19-51c6-a28a-239999dea5de
2025-12-05 20:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640f00d0>
2025-12-05 20:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_4.jpg saved to cache
2025-12-05 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 652cbaa6-caba-53bf-9524-0d49c3ca865e
2025-12-05 20:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640fc210>
2025-12-05 20:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_7.jpg saved to cache
2025-12-05 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ece1f6a2-0b48-5604-adc2-850b2ea40751
2025-12-05 20:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6443cf10>
2025-12-05 20:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_7.jpg saved to cache
2025-12-05 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ece1f6a2-0b48-5604-adc2-850b2ea40751
2025-12-05 20:02:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ece1f6a2-0b48-5604-adc2-850b2ea40751, skipping ID generation
2025-12-05 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ece1f6a2-0b48-5604-adc2-850b2ea40751 from tracking dictionaries
2025-12-05 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ece1f6a2-0b48-5604-adc2-850b2ea40751 sending to next pipeline
2025-12-05 20:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: ece1f6a2-0b48-5604-adc2-850b2ea40751, identifier: 1512515
2025-12-05 20:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: ece1f6a2-0b48-5604-adc2-850b2ea40751 with identifier: 1512515
2025-12-05 20:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: ece1f6a2-0b48-5604-adc2-850b2ea40751 with identifier: 1512515
2025-12-05 20:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 15 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
15
2025-12-05 20:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: ece1f6a2-0b48-5604-adc2-850b2ea40751 spider: manheim.gb
2025-12-05 20:02:15 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: ece1f6a2-0b48-5604-adc2-850b2ea40751 due to rule: registration_date_old.json, error: 15 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
15
{'auction_title': '',
'c_o_2_emission_value': 167,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_expert_report_file_a45d0587-3363-41b8-9468-c491caa928a6.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001512515-01985662-002.pdf',
'color': 'BLUE',
'currency': 'GBP',
'engine': '1.6L',
'expiration_date': '2025-12-08T09:00:00Z',
'fuel_type': 'Petrol',
'id': 'ece1f6a2-0b48-5604-adc2-850b2ea40751',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YE10AXN',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MINI/CLUBMAN?id=1512515',
'listing': 'auction',
'location': 'Leeds',
'make': 'MINI',
'model': 'CLUBMAN',
'odometer': 79102,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 63,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204405,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204405,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 227653,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 190387,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189810,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 190836,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 191292,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184057,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 193393,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 225756,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204599,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204277,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 240475,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/426a1c40-f5b2-4785-9e43-015a8abc23ea_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339099,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1512515-4009920-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 451626,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1512515-4009920-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 373631,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1512515-4009920-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 205410,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1512515-4009920-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 372548,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1512515-4009920-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385643,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1512515-4009920-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece1f6a2-0b48-5604-adc2-850b2ea40751/ece1f6a2-0b48-5604-adc2-850b2ea40751_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386195,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1512515-4009920-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-01',
'seller_name': 'Lloyd Motor Group',
'title': 'MINI CLUBMAN 1.6 John Cooper Works 5dr [Chili/Media Pack]',
'transmission': 'manual',
'trim': '1.6 John Cooper Works 5dr [Chili/Media Pack]',
'year': 2010}
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271512515%27 HTTP/1.1" 200 None
2025-12-05 20:02:15 [manheim.gb] INFO: Saving data for 1512515: {'created_time': 1764964935.179388, 'last_price_update_time': 1764964935.179398, 'auction_closing_time': 1765184400.0}
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1512515') HTTP/1.1" 204 0
2025-12-05 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001773610-01989969-002.pdf)
2025-12-05 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001773610-01989969-002.pdf)
2025-12-05 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001589816-01994458-002.pdf)
2025-12-05 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001589816-01994458-002.pdf)
2025-12-05 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001773610-01989969-002.pdf)
2025-12-05 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MAZDA/2?id=2247450&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232247450&indx=88> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2f9110>
2025-12-05 20:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdb8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_7.jpg saved to cache
2025-12-05 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a717d04a-3a19-51c6-a28a-239999dea5de
2025-12-05 20:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6408b890>
2025-12-05 20:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdb8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_7.jpg saved to cache
2025-12-05 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a717d04a-3a19-51c6-a28a-239999dea5de
2025-12-05 20:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6445b150>
2025-12-05 20:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_5.jpg saved to cache
2025-12-05 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 652cbaa6-caba-53bf-9524-0d49c3ca865e
2025-12-05 20:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fb9b890>
2025-12-05 20:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_2.jpg saved to cache
2025-12-05 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 652cbaa6-caba-53bf-9524-0d49c3ca865e
2025-12-05 20:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc642839d0>
2025-12-05 20:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdb8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_6.jpg saved to cache
2025-12-05 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a717d04a-3a19-51c6-a28a-239999dea5de
2025-12-05 20:02:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a717d04a-3a19-51c6-a28a-239999dea5de, skipping ID generation
2025-12-05 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a717d04a-3a19-51c6-a28a-239999dea5de from tracking dictionaries
2025-12-05 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a717d04a-3a19-51c6-a28a-239999dea5de sending to next pipeline
2025-12-05 20:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: a717d04a-3a19-51c6-a28a-239999dea5de, identifier: 1773610
2025-12-05 20:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13 with identifier: 2247450
2025-12-05 20:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13 with scrape type 2
2025-12-05 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13 with scrape type 2
2025-12-05 20:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13, identifier: 2247450
2025-12-05 20:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001589816-01994458-002.pdf)
2025-12-05 20:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: a717d04a-3a19-51c6-a28a-239999dea5de with identifier: 1773610
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:02:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=SILVER HTTP/1.1" 200 None
2025-12-05 20:02:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: a717d04a-3a19-51c6-a28a-239999dea5de with identifier: 1773610
2025-12-05 20:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
2025-12-05 20:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: a717d04a-3a19-51c6-a28a-239999dea5de spider: manheim.gb
2025-12-05 20:02:17 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: a717d04a-3a19-51c6-a28a-239999dea5de due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
{'auction_title': '',
'c_o_2_emission_value': 123,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_expert_report_file_630e7c6c-8603-4480-b26d-ec8331eb1b3e.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001773610-01989969-002.pdf',
'color': 'SILVER',
'currency': 'GBP',
'engine': '1.4L',
'expiration_date': '2025-12-09T09:00:00Z',
'fuel_type': 'Petrol',
'id': 'a717d04a-3a19-51c6-a28a-239999dea5de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OY65URH',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=1773610',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 33556,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 33,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 171279,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 171279,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263565,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 209143,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184438,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 175101,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179631,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 174168,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 178083,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 268417,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 238635,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 219578,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198460,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/db8422e7-be6b-4a10-ae13-e0090ac9d1e3_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 234279,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1773610-4005797-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 469525,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1773610-4005797-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176531,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1773610-4005797-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 221134,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1773610-4005797-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216999,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1773610-4005797-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 225856,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1773610-4005797-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a717d04a-3a19-51c6-a28a-239999dea5de/a717d04a-3a19-51c6-a28a-239999dea5de_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 218736,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1773610-4005797-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-29',
'seller_name': 'NextGear Capital UK Ltd',
'title': 'VAUXHALL CORSA 1.4T [100] SRi Vx-line 5dr',
'transmission': 'manual',
'trim': '1.4T [100] SRi Vx-line 5dr',
'year': 2015}
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271773610%27 HTTP/1.1" 200 None
2025-12-05 20:02:17 [manheim.gb] INFO: Saving data for 1773610: {'created_time': 1764964937.294123, 'last_price_update_time': 1764964937.294132, 'auction_closing_time': 1765270800.0}
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1773610') HTTP/1.1" 204 0
2025-12-05 20:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13 with identifier: 2247450
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=ORANGE HTTP/1.1" 200 None
2025-12-05 20:02:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13 with identifier: 2247450
2025-12-05 20:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 15 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
15
2025-12-05 20:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13 spider: manheim.gb
2025-12-05 20:02:17 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 02f86a59-5d45-5bc0-a6cd-8af80f1a5c13 due to rule: registration_date_old.json, error: 15 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
15
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002247450-01991075-003.pdf',
'color': 'ORANGE',
'currency': 'GBP',
'engine': '1.3L',
'expiration_date': '2025-12-10T09:00:00Z',
'fuel_type': 'Petrol',
'id': '02f86a59-5d45-5bc0-a6cd-8af80f1a5c13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YG10UMO',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MAZDA/2?id=2247450',
'listing': 'auction',
'location': 'Birmingham',
'make': 'MAZDA',
'model': '2',
'odometer': 78977,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-04-30',
'seller_name': 'Available Car',
'title': 'MAZDA 2 1.3 TS2 5dr',
'transmission': 'manual',
'trim': '1.3 TS2 5dr',
'year': 2010}
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272247450%27 HTTP/1.1" 200 None
2025-12-05 20:02:17 [manheim.gb] INFO: Saving data for 2247450: {'auction_closing_time': 1765357200.0, 'created_time': 1764842939.917414, 'last_price_update_time': 1764964937.697746}
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2247450') HTTP/1.1" 204 0
2025-12-05 20:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001589816-01994458-002.pdf)
2025-12-05 20:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001589816-01994458-002.pdf)
2025-12-05 20:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001589816-01994458-002.pdf)
2025-12-05 20:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001589816-01994458-002.pdf)
2025-12-05 20:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001589816-01994458-002.pdf)
2025-12-05 20:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/XTRAIL?id=2218237&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232218237&indx=86> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:02:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64760f90>
2025-12-05 20:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_1.jpg saved to cache
2025-12-05 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 652cbaa6-caba-53bf-9524-0d49c3ca865e
2025-12-05 20:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc645e0dd0>
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_10.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_10.jpg saved to cache
2025-12-05 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 652cbaa6-caba-53bf-9524-0d49c3ca865e
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fb82fd0>
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_9.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_9.jpg saved to cache
2025-12-05 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 652cbaa6-caba-53bf-9524-0d49c3ca865e
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6418cc90>
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_11.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_11.jpg saved to cache
2025-12-05 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 652cbaa6-caba-53bf-9524-0d49c3ca865e
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc641c10d0>
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_4.jpg saved to cache
2025-12-05 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 652cbaa6-caba-53bf-9524-0d49c3ca865e
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fb83950>
2025-12-05 20:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_5.jpg saved to cache
2025-12-05 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 652cbaa6-caba-53bf-9524-0d49c3ca865e
2025-12-05 20:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b with identifier: 2218237
2025-12-05 20:02:19 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b
2025-12-05 20:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/AUDI/A1?id=2383536&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232383536&indx=103> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:02:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001589816-01994458-002.pdf)
2025-12-05 20:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001589816-01994458-002.pdf)
2025-12-05 20:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0880270-134e-5826-af41-f8aadd0df2b8 with identifier: 2383536
2025-12-05 20:02:19 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e0880270-134e-5826-af41-f8aadd0df2b8
2025-12-05 20:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fb9a6d0>
2025-12-05 20:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_6.jpg saved to cache
2025-12-05 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 652cbaa6-caba-53bf-9524-0d49c3ca865e
2025-12-05 20:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64250690>
2025-12-05 20:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_7.jpg saved to cache
2025-12-05 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 652cbaa6-caba-53bf-9524-0d49c3ca865e
2025-12-05 20:02:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 652cbaa6-caba-53bf-9524-0d49c3ca865e, skipping ID generation
2025-12-05 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 652cbaa6-caba-53bf-9524-0d49c3ca865e from tracking dictionaries
2025-12-05 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 652cbaa6-caba-53bf-9524-0d49c3ca865e sending to next pipeline
2025-12-05 20:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 652cbaa6-caba-53bf-9524-0d49c3ca865e, identifier: 1589816
2025-12-05 20:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 652cbaa6-caba-53bf-9524-0d49c3ca865e with identifier: 1589816
2025-12-05 20:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 652cbaa6-caba-53bf-9524-0d49c3ca865e with identifier: 1589816
2025-12-05 20:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 11 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
11
2025-12-05 20:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 652cbaa6-caba-53bf-9524-0d49c3ca865e spider: manheim.gb
2025-12-05 20:02:20 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 652cbaa6-caba-53bf-9524-0d49c3ca865e due to rule: registration_date_old.json, error: 11 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
11
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_expert_report_file_7ad26f4c-7b55-48fc-8ccc-fe971b3937f0.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001589816-01994458-002.pdf',
'color': 'WHITE',
'currency': 'GBP',
'engine': '1.5L',
'expiration_date': '2025-12-10T09:00:00Z',
'fuel_type': 'Diesel',
'id': '652cbaa6-caba-53bf-9524-0d49c3ca865e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YS14WGC',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=1589816',
'listing': 'auction',
'location': 'Plymouth',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 88702,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 213962,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 213962,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195810,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 193371,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216894,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214577,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 205401,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 206825,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 211228,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 224715,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 222998,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 165709,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 234115,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8471c6b1-d4fc-4b93-b726-aa1f7d5f4891_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367878,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1589816-4010316-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292854,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1589816-4010316-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379360,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1589816-4010316-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409233,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1589816-4010316-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387350,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1589816-4010316-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345192,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1589816-4010316-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652cbaa6-caba-53bf-9524-0d49c3ca865e/652cbaa6-caba-53bf-9524-0d49c3ca865e_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113253,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1589816-4010316-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-18',
'seller_name': 'Oplo CF Limited',
'title': 'NISSAN JUKE 1.5 dCi N-Tec 5dr [Start Stop]',
'transmission': 'manual',
'trim': '1.5 dCi N-Tec 5dr [Start Stop]',
'year': 2014}
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271589816%27 HTTP/1.1" 200 None
2025-12-05 20:02:20 [manheim.gb] INFO: Saving data for 1589816: {'created_time': 1764964940.185256, 'last_price_update_time': 1764964940.185265, 'auction_closing_time': 1765357200.0}
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1589816') HTTP/1.1" 204 0
2025-12-05 20:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002383536-01993751-002.pdf> (referer: None)
2025-12-05 20:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002218237-01991997-002.pdf> (referer: None)
2025-12-05 20:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DISCOVERYSPORT?id=2075642&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232075642&indx=75> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fbf2210>
2025-12-05 20:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_expert_report_file_19533689-f46f-4441-9a7e-fa779034117e.pdf HTTP/1.1" 201 0
2025-12-05 20:02:20 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e0880270-134e-5826-af41-f8aadd0df2b8
2025-12-05 20:02:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e0880270-134e-5826-af41-f8aadd0df2b8, skipping ID generation
2025-12-05 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item e0880270-134e-5826-af41-f8aadd0df2b8
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Feb88742b-7445-478e-833b-a60d3049d269_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_7.jpg not downloaded yet
2025-12-05 20:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e530150>
2025-12-05 20:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_expert_report_file_6ba2e8ea-cce9-444c-9e0d-26017d13c44f.pdf HTTP/1.1" 201 0
2025-12-05 20:02:20 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b
2025-12-05 20:02:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b, skipping ID generation
2025-12-05 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_7.jpg not downloaded yet
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Feb88742b-7445-478e-833b-a60d3049d269_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_7.jpg not downloaded yet
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_7.jpg not downloaded yet
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Feb88742b-7445-478e-833b-a60d3049d269_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_6.jpg not downloaded yet
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_6.jpg not downloaded yet
2025-12-05 20:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 830b15cf-d0d5-5221-9d29-e2fb63578fe6 with identifier: 2075642
2025-12-05 20:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 830b15cf-d0d5-5221-9d29-e2fb63578fe6 with scrape type 2
2025-12-05 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 830b15cf-d0d5-5221-9d29-e2fb63578fe6 with scrape type 2
2025-12-05 20:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 830b15cf-d0d5-5221-9d29-e2fb63578fe6, identifier: 2075642
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Feb88742b-7445-478e-833b-a60d3049d269_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_1.jpg not downloaded yet
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_1.jpg not downloaded yet
2025-12-05 20:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 830b15cf-d0d5-5221-9d29-e2fb63578fe6 with identifier: 2075642
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:02:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Silver HTTP/1.1" 200 None
2025-12-05 20:02:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 830b15cf-d0d5-5221-9d29-e2fb63578fe6 with identifier: 2075642
2025-12-05 20:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 830b15cf-d0d5-5221-9d29-e2fb63578fe6 with identifier: 2075642 to the API
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DISCOVERYSPORT?id=2075642&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232075642&indx=75>
{'auction_title': '',
'c_o_2_emission_value': 169,
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002075642-01981819-003.pdf',
'color': 'Silver',
'currency': 'GBP',
'engine': '2.0L',
'expiration_date': '2025-12-09T09:00:00Z',
'fuel_type': 'Diesel',
'id': '830b15cf-d0d5-5221-9d29-e2fb63578fe6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KW67VOU',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DISCOVERY%20SPORT?id=2075642',
'listing': 'auction',
'location': 'Colchester',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 37182,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-20',
'seller_name': 'Lookers',
'title': 'LAND ROVER DISCOVERY SPORT 2.0 SD4 240 HSE Dynamic Luxury 5dr Auto',
'transmission': 'automatic',
'trim': '2.0 SD4 240 HSE Dynamic Luxury 5dr Auto',
'year': 2017}
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272075642%27 HTTP/1.1" 200 None
2025-12-05 20:02:22 [manheim.gb] INFO: Saving data for 2075642: {'auction_closing_time': 1765270800.0, 'created_time': 1764583968.866378, 'last_price_update_time': 1764964942.62563}
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2075642') HTTP/1.1" 204 0
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Feb88742b-7445-478e-833b-a60d3049d269_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_5.jpg not downloaded yet
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_5.jpg not downloaded yet
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Feb88742b-7445-478e-833b-a60d3049d269_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_4.jpg not downloaded yet
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_4.jpg not downloaded yet
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Feb88742b-7445-478e-833b-a60d3049d269_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_11.jpg not downloaded yet
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_11.jpg not downloaded yet
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Feb88742b-7445-478e-833b-a60d3049d269_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_10.jpg not downloaded yet
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_10.jpg not downloaded yet
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Feb88742b-7445-478e-833b-a60d3049d269_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_9.jpg not downloaded yet
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_9.jpg not downloaded yet
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Feb88742b-7445-478e-833b-a60d3049d269_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_2.jpg not downloaded yet
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_2.jpg not downloaded yet
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Feb88742b-7445-478e-833b-a60d3049d269_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_5.jpg not downloaded yet
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_5.jpg not downloaded yet
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Feb88742b-7445-478e-833b-a60d3049d269_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_3.jpg not downloaded yet
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_3.jpg not downloaded yet
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Feb88742b-7445-478e-833b-a60d3049d269_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_4.jpg not downloaded yet
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_4.jpg not downloaded yet
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2383536-4009486-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2383536-4009486-13.jpg not downloaded yet
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2218237-4010022-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2218237-4010022-13.jpg not downloaded yet
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2383536-4009486-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2383536-4009486-1000.jpg not downloaded yet
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2218237-4010022-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2218237-4010022-1000.jpg not downloaded yet
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2383536-4009486-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2383536-4009486-1001.jpg not downloaded yet
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2218237-4010022-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2218237-4010022-1001.jpg not downloaded yet
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2383536-4009486-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2383536-4009486-1002.jpg not downloaded yet
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2218237-4010022-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2218237-4010022-1002.jpg not downloaded yet
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2383536-4009486-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2383536-4009486-1003.jpg not downloaded yet
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2218237-4010022-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2218237-4010022-1003.jpg not downloaded yet
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2383536-4009486-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2383536-4009486-1004.jpg not downloaded yet
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2218237-4010022-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2218237-4010022-1004.jpg not downloaded yet
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2383536-4009486-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2383536-4009486-1005.jpg not downloaded yet
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2218237-4010022-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2218237-4010022-1005.jpg not downloaded yet
2025-12-05 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/JAGUAR/XF?id=2143943&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232143943&indx=80> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:02:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c31f3c30-4a52-5772-a6f7-e4cfaf567d8b with identifier: 2143943
2025-12-05 20:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c31f3c30-4a52-5772-a6f7-e4cfaf567d8b with scrape type 2
2025-12-05 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c31f3c30-4a52-5772-a6f7-e4cfaf567d8b with scrape type 2
2025-12-05 20:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: c31f3c30-4a52-5772-a6f7-e4cfaf567d8b, identifier: 2143943
2025-12-05 20:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: c31f3c30-4a52-5772-a6f7-e4cfaf567d8b with identifier: 2143943
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Grey HTTP/1.1" 200 None
2025-12-05 20:02:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: c31f3c30-4a52-5772-a6f7-e4cfaf567d8b with identifier: 2143943
2025-12-05 20:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 165757 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
165757
2025-12-05 20:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c31f3c30-4a52-5772-a6f7-e4cfaf567d8b spider: manheim.gb
2025-12-05 20:02:23 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: c31f3c30-4a52-5772-a6f7-e4cfaf567d8b due to rule: high_mileage_for_country.json, error: 165757 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
165757
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002143943-01982616-003.pdf',
'color': 'Grey',
'currency': 'GBP',
'engine': '2.2L',
'expiration_date': '2025-12-11T09:00:00Z',
'fuel_type': 'Diesel',
'id': 'c31f3c30-4a52-5772-a6f7-e4cfaf567d8b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BX61WDE',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/JAGUAR/XF?id=2143943',
'listing': 'auction',
'location': 'Colchester',
'make': 'JAGUAR',
'model': 'XF',
'odometer': 102997,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-20',
'seller_name': 'Thurlow Nunn',
'title': 'JAGUAR XF 2.2d Portfolio 4dr Auto',
'transmission': 'automatic',
'trim': '2.2d Portfolio 4dr Auto',
'year': 2012}
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272143943%27 HTTP/1.1" 200 None
2025-12-05 20:02:23 [manheim.gb] INFO: Saving data for 2143943: {'auction_closing_time': 1765443600.0, 'created_time': 1764669814.706472, 'last_price_update_time': 1764964943.947633}
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2143943') HTTP/1.1" 204 0
2025-12-05 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2383536-4009486-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002383536-01993751-002.pdf)
2025-12-05 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2218237-4010022-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002218237-01991997-002.pdf)
2025-12-05 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2383536-4009486-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002383536-01993751-002.pdf)
2025-12-05 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2383536-4009486-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002383536-01993751-002.pdf)
2025-12-05 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2218237-4010022-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002218237-01991997-002.pdf)
2025-12-05 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2218237-4010022-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002218237-01991997-002.pdf)
2025-12-05 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2218237-4010022-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002218237-01991997-002.pdf)
2025-12-05 20:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6460f250>
2025-12-05 20:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_17.jpg HTTP/1.1" 201 0
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2383536-4009486-1003.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2383536-4009486-1003.jpg saved to cache
2025-12-05 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item e0880270-134e-5826-af41-f8aadd0df2b8
2025-12-05 20:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6418c050>
2025-12-05 20:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_18.jpg HTTP/1.1" 201 0
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2218237-4010022-1004.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2218237-4010022-1004.jpg saved to cache
2025-12-05 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b
2025-12-05 20:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640f2390>
2025-12-05 20:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_19.jpg HTTP/1.1" 201 0
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2383536-4009486-1005.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2383536-4009486-1005.jpg saved to cache
2025-12-05 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item e0880270-134e-5826-af41-f8aadd0df2b8
2025-12-05 20:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2383536-4009486-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002383536-01993751-002.pdf)
2025-12-05 20:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6446f790>
2025-12-05 20:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_18.jpg HTTP/1.1" 201 0
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2383536-4009486-1004.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2383536-4009486-1004.jpg saved to cache
2025-12-05 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item e0880270-134e-5826-af41-f8aadd0df2b8
2025-12-05 20:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fb98210>
2025-12-05 20:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_19.jpg HTTP/1.1" 201 0
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2218237-4010022-1005.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2218237-4010022-1005.jpg saved to cache
2025-12-05 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b
2025-12-05 20:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6419d9d0>
2025-12-05 20:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_16.jpg HTTP/1.1" 201 0
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2218237-4010022-1002.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2218237-4010022-1002.jpg saved to cache
2025-12-05 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b
2025-12-05 20:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e529ad0>
2025-12-05 20:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_17.jpg HTTP/1.1" 201 0
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2218237-4010022-1003.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2218237-4010022-1003.jpg saved to cache
2025-12-05 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b
2025-12-05 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2383536-4009486-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002383536-01993751-002.pdf)
2025-12-05 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2218237-4010022-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002218237-01991997-002.pdf)
2025-12-05 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2383536-4009486-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002383536-01993751-002.pdf)
2025-12-05 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2218237-4010022-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002218237-01991997-002.pdf)
2025-12-05 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2218237-4010022-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002218237-01991997-002.pdf)
2025-12-05 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2383536-4009486-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002383536-01993751-002.pdf)
2025-12-05 20:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64377150>
2025-12-05 20:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2383536-4009486-1000.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2383536-4009486-1000.jpg saved to cache
2025-12-05 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item e0880270-134e-5826-af41-f8aadd0df2b8
2025-12-05 20:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc643296d0>
2025-12-05 20:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_15.jpg HTTP/1.1" 201 0
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2383536-4009486-1001.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2383536-4009486-1001.jpg saved to cache
2025-12-05 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item e0880270-134e-5826-af41-f8aadd0df2b8
2025-12-05 20:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc645f87d0>
2025-12-05 20:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2218237-4010022-13.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2218237-4010022-13.jpg saved to cache
2025-12-05 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64093b90>
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2383536-4009486-13.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2383536-4009486-13.jpg saved to cache
2025-12-05 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item e0880270-134e-5826-af41-f8aadd0df2b8
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc645f88d0>
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2218237-4010022-1000.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2218237-4010022-1000.jpg saved to cache
2025-12-05 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2f24d0>
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_15.jpg HTTP/1.1" 201 0
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2218237-4010022-1001.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2218237-4010022-1001.jpg saved to cache
2025-12-05 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc645fa810>
2025-12-05 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_16.jpg HTTP/1.1" 201 0
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2383536-4009486-1002.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2383536-4009486-1002.jpg saved to cache
2025-12-05 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item e0880270-134e-5826-af41-f8aadd0df2b8
2025-12-05 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002383536-01993751-002.pdf)
2025-12-05 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002383536-01993751-002.pdf)
2025-12-05 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002218237-01991997-002.pdf)
2025-12-05 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002218237-01991997-002.pdf)
2025-12-05 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002383536-01993751-002.pdf)
2025-12-05 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002218237-01991997-002.pdf)
2025-12-05 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002218237-01991997-002.pdf)
2025-12-05 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/208?id=21085&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%2321085&indx=78> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64086490>
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Feb88742b-7445-478e-833b-a60d3049d269_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_3.jpg saved to cache
2025-12-05 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e0880270-134e-5826-af41-f8aadd0df2b8
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2b0c10>
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Feb88742b-7445-478e-833b-a60d3049d269_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_4.jpg saved to cache
2025-12-05 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e0880270-134e-5826-af41-f8aadd0df2b8
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f231990>
2025-12-05 20:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_4.jpg saved to cache
2025-12-05 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64229950>
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_5.jpg saved to cache
2025-12-05 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e4ff510>
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Feb88742b-7445-478e-833b-a60d3049d269_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_5.jpg saved to cache
2025-12-05 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e0880270-134e-5826-af41-f8aadd0df2b8
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2b3dd0>
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_3.jpg saved to cache
2025-12-05 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2b3d50>
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_2.jpg saved to cache
2025-12-05 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b
2025-12-05 20:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee with identifier: 21085
2025-12-05 20:02:30 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee
2025-12-05 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002383536-01993751-002.pdf)
2025-12-05 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002383536-01993751-002.pdf)
2025-12-05 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002218237-01991997-002.pdf)
2025-12-05 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002218237-01991997-002.pdf)
2025-12-05 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002218237-01991997-002.pdf)
2025-12-05 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002218237-01991997-002.pdf)
2025-12-05 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002383536-01993751-002.pdf)
2025-12-05 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002383536-01993751-002.pdf)
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fbf1e90>
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Feb88742b-7445-478e-833b-a60d3049d269_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_2.jpg saved to cache
2025-12-05 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e0880270-134e-5826-af41-f8aadd0df2b8
2025-12-05 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002218237-01991997-002.pdf)
2025-12-05 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002218237-01991997-002.pdf)
2025-12-05 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002383536-01993751-002.pdf)
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f22c990>
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Feb88742b-7445-478e-833b-a60d3049d269_10.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_10.jpg saved to cache
2025-12-05 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e0880270-134e-5826-af41-f8aadd0df2b8
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2aa490>
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_11.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_11.jpg saved to cache
2025-12-05 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64229890>
2025-12-05 20:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_9.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_9.jpg saved to cache
2025-12-05 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64305810>
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_4.jpg saved to cache
2025-12-05 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc642a9290>
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_10.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_10.jpg saved to cache
2025-12-05 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc65b3b310>
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Feb88742b-7445-478e-833b-a60d3049d269_11.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_11.jpg saved to cache
2025-12-05 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e0880270-134e-5826-af41-f8aadd0df2b8
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc641ec550>
2025-12-05 20:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Feb88742b-7445-478e-833b-a60d3049d269_9.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_9.jpg saved to cache
2025-12-05 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e0880270-134e-5826-af41-f8aadd0df2b8
2025-12-05 20:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002383536-01993751-002.pdf)
2025-12-05 20:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002383536-01993751-002.pdf)
2025-12-05 20:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002383536-01993751-002.pdf)
2025-12-05 20:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002218237-01991997-002.pdf)
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6441c690>
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_5.jpg saved to cache
2025-12-05 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2d40d0>
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_1.jpg saved to cache
2025-12-05 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc641746d0>
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Feb88742b-7445-478e-833b-a60d3049d269_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_5.jpg saved to cache
2025-12-05 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e0880270-134e-5826-af41-f8aadd0df2b8
2025-12-05 20:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002218237-01991997-002.pdf)
2025-12-05 20:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002218237-01991997-002.pdf)
2025-12-05 20:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002383536-01993751-002.pdf)
2025-12-05 20:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002383536-01993751-002.pdf)
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc644a2c10>
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Feb88742b-7445-478e-833b-a60d3049d269_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_6.jpg saved to cache
2025-12-05 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e0880270-134e-5826-af41-f8aadd0df2b8
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc645e0650>
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Feb88742b-7445-478e-833b-a60d3049d269_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_4.jpg saved to cache
2025-12-05 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e0880270-134e-5826-af41-f8aadd0df2b8
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc644a2d50>
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Feb88742b-7445-478e-833b-a60d3049d269_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_1.jpg saved to cache
2025-12-05 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e0880270-134e-5826-af41-f8aadd0df2b8
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fb988d0>
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_6.jpg saved to cache
2025-12-05 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b
2025-12-05 20:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/ACLASS?id=2390902&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232390902&indx=105> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2b4190>
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_7.jpg saved to cache
2025-12-05 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64250550>
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_7.jpg saved to cache
2025-12-05 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b
2025-12-05 20:02:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b, skipping ID generation
2025-12-05 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b from tracking dictionaries
2025-12-05 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b sending to next pipeline
2025-12-05 20:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b, identifier: 2218237
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6441d010>
2025-12-05 20:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Feb88742b-7445-478e-833b-a60d3049d269_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_7.jpg saved to cache
2025-12-05 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e0880270-134e-5826-af41-f8aadd0df2b8
2025-12-05 20:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640d9450>
2025-12-05 20:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Feb88742b-7445-478e-833b-a60d3049d269_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_7.jpg saved to cache
2025-12-05 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e0880270-134e-5826-af41-f8aadd0df2b8
2025-12-05 20:02:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e0880270-134e-5826-af41-f8aadd0df2b8, skipping ID generation
2025-12-05 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e0880270-134e-5826-af41-f8aadd0df2b8 from tracking dictionaries
2025-12-05 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e0880270-134e-5826-af41-f8aadd0df2b8 sending to next pipeline
2025-12-05 20:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e0880270-134e-5826-af41-f8aadd0df2b8, identifier: 2383536
2025-12-05 20:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b with identifier: 2218237
2025-12-05 20:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b with identifier: 2218237
2025-12-05 20:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
2025-12-05 20:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b spider: manheim.gb
2025-12-05 20:02:35 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_expert_report_file_6ba2e8ea-cce9-444c-9e0d-26017d13c44f.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002218237-01991997-002.pdf',
'color': 'BLACK',
'currency': 'GBP',
'engine': '1.6L',
'expiration_date': '2025-12-11T09:00:00Z',
'fuel_type': 'Diesel',
'id': 'cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ST65UUA',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/X-TRAIL?id=2218237',
'listing': 'auction',
'location': 'Colchester',
'make': 'NISSAN',
'model': 'X-TRAIL',
'odometer': 90343,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 33,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 166729,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 166729,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 276929,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214528,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 159232,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151563,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 158358,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 145671,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 155975,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 269261,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 240476,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 251693,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223961,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d6f224d-fd3b-4641-bb0d-e9c9ea99ad5a_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294784,
'Height': 843,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2218237-4010022-13.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283804,
'Height': 843,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2218237-4010022-1000.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303688,
'Height': 843,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2218237-4010022-1001.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257311,
'Height': 843,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2218237-4010022-1002.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327840,
'Height': 843,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2218237-4010022-1003.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 234798,
'Height': 843,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2218237-4010022-1004.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b/cb6be4bf-abcb-5ce4-b80c-dbd86e0baf4b_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 227296,
'Height': 843,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2218237-4010022-1005.jpg',
'Width': 1500}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-21',
'seller_name': 'Stellantis & You',
'title': 'NISSAN X-TRAIL 1.6 dCi Tekna 5dr Xtronic',
'transmission': 'automatic',
'trim': '1.6 dCi Tekna 5dr Xtronic',
'year': 2015}
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272218237%27 HTTP/1.1" 200 None
2025-12-05 20:02:35 [manheim.gb] INFO: Saving data for 2218237: {'created_time': 1764964955.792296, 'last_price_update_time': 1764964955.792305, 'auction_closing_time': 1765443600.0}
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2218237') HTTP/1.1" 204 0
2025-12-05 20:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e0880270-134e-5826-af41-f8aadd0df2b8 with identifier: 2383536
2025-12-05 20:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e0880270-134e-5826-af41-f8aadd0df2b8 with identifier: 2383536
2025-12-05 20:02:35 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: e0880270-134e-5826-af41-f8aadd0df2b8 with identifier: 2383536 to the API
2025-12-05 20:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_expert_report_file_19533689-f46f-4441-9a7e-fa779034117e.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002383536-01993751-002.pdf',
'color': 'WHITE',
'currency': 'GBP',
'engine': '1.4L',
'expiration_date': '2025-12-08T09:00:00Z',
'fuel_type': 'Petrol',
'id': 'e0880270-134e-5826-af41-f8aadd0df2b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LR16YUL',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/A1?id=2383536',
'listing': 'auction',
'location': 'Birmingham',
'make': 'AUDI',
'model': 'A1',
'odometer': 29667,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 209617,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 209617,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168865,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196427,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 208351,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 211168,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 191881,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 201235,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199712,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 231456,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220204,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168330,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210888,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/eb88742b-7445-478e-833b-a60d3049d269_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290249,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2383536-4009486-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 183994,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2383536-4009486-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252267,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2383536-4009486-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294858,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2383536-4009486-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217747,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2383536-4009486-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 269250,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2383536-4009486-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0880270-134e-5826-af41-f8aadd0df2b8/e0880270-134e-5826-af41-f8aadd0df2b8_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 145679,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2383536-4009486-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-24',
'seller_name': 'Big Motoring World Ltd',
'title': 'AUDI A1 1.4 TFSI 150 S Line 3dr',
'transmission': 'manual',
'trim': '1.4 TFSI 150 S Line 3dr',
'year': 2016}
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272383536%27 HTTP/1.1" 200 None
2025-12-05 20:02:36 [manheim.gb] INFO: Saving data for 2383536: {'created_time': 1764964956.216988, 'last_price_update_time': 1764964956.216998, 'auction_closing_time': 1765184400.0}
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2383536') HTTP/1.1" 204 0
2025-12-05 20:02:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bda70b0-ec23-578b-aebc-93b4bbdf9c49 with identifier: 2390902
2025-12-05 20:02:36 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5bda70b0-ec23-578b-aebc-93b4bbdf9c49
2025-12-05 20:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0000021085-01987611-002.pdf> (referer: None)
2025-12-05 20:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2f1810>
2025-12-05 20:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_expert_report_file_f3817d35-5c4f-4e79-ba18-b974938b39e9.pdf HTTP/1.1" 201 0
2025-12-05 20:02:36 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee
2025-12-05 20:02:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee, skipping ID generation
2025-12-05 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F365faf96-a87b-4a0e-a7af-99a78070f914_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_7.jpg not downloaded yet
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F365faf96-a87b-4a0e-a7af-99a78070f914_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_7.jpg not downloaded yet
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F365faf96-a87b-4a0e-a7af-99a78070f914_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_6.jpg not downloaded yet
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F365faf96-a87b-4a0e-a7af-99a78070f914_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_1.jpg not downloaded yet
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F365faf96-a87b-4a0e-a7af-99a78070f914_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_5.jpg not downloaded yet
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F365faf96-a87b-4a0e-a7af-99a78070f914_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_4.jpg not downloaded yet
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F365faf96-a87b-4a0e-a7af-99a78070f914_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_11.jpg not downloaded yet
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F365faf96-a87b-4a0e-a7af-99a78070f914_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_10.jpg not downloaded yet
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F365faf96-a87b-4a0e-a7af-99a78070f914_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_9.jpg not downloaded yet
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F365faf96-a87b-4a0e-a7af-99a78070f914_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_2.jpg not downloaded yet
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F365faf96-a87b-4a0e-a7af-99a78070f914_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_5.jpg not downloaded yet
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F365faf96-a87b-4a0e-a7af-99a78070f914_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_3.jpg not downloaded yet
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F365faf96-a87b-4a0e-a7af-99a78070f914_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_4.jpg not downloaded yet
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-21085-4009700-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-21085-4009700-13.jpg not downloaded yet
2025-12-05 20:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=2392879&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232392879&indx=106> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-21085-4009700-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-21085-4009700-1000.jpg not downloaded yet
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-21085-4009700-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-21085-4009700-1001.jpg not downloaded yet
2025-12-05 20:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000021085-01987611-002.pdf)
2025-12-05 20:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000021085-01987611-002.pdf)
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-21085-4009700-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-21085-4009700-1002.jpg not downloaded yet
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-21085-4009700-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-21085-4009700-1003.jpg not downloaded yet
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-21085-4009700-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-21085-4009700-1004.jpg not downloaded yet
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-21085-4009700-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-21085-4009700-1005.jpg not downloaded yet
2025-12-05 20:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000021085-01987611-002.pdf)
2025-12-05 20:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 315bc698-72b6-5d57-8d26-758a555a1575 with identifier: 2392879
2025-12-05 20:02:37 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 315bc698-72b6-5d57-8d26-758a555a1575
2025-12-05 20:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000021085-01987611-002.pdf)
2025-12-05 20:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2d5e90>
2025-12-05 20:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F365faf96-a87b-4a0e-a7af-99a78070f914_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_7.jpg saved to cache
2025-12-05 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee
2025-12-05 20:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc643adf90>
2025-12-05 20:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F365faf96-a87b-4a0e-a7af-99a78070f914_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_7.jpg saved to cache
2025-12-05 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee
2025-12-05 20:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000021085-01987611-002.pdf)
2025-12-05 20:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000021085-01987611-002.pdf)
2025-12-05 20:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000021085-01987611-002.pdf)
2025-12-05 20:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000021085-01987611-002.pdf)
2025-12-05 20:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000021085-01987611-002.pdf)
2025-12-05 20:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-21085-4009700-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000021085-01987611-002.pdf)
2025-12-05 20:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fba6090>
2025-12-05 20:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F365faf96-a87b-4a0e-a7af-99a78070f914_11.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_11.jpg saved to cache
2025-12-05 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee
2025-12-05 20:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64282210>
2025-12-05 20:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F365faf96-a87b-4a0e-a7af-99a78070f914_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_5.jpg saved to cache
2025-12-05 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee
2025-12-05 20:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-21085-4009700-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000021085-01987611-002.pdf)
2025-12-05 20:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-21085-4009700-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000021085-01987611-002.pdf)
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640c1a10>
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F365faf96-a87b-4a0e-a7af-99a78070f914_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_6.jpg saved to cache
2025-12-05 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6429ddd0>
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F365faf96-a87b-4a0e-a7af-99a78070f914_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_1.jpg saved to cache
2025-12-05 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2b3f10>
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F365faf96-a87b-4a0e-a7af-99a78070f914_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_4.jpg saved to cache
2025-12-05 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e529ad0>
2025-12-05 20:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F365faf96-a87b-4a0e-a7af-99a78070f914_10.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_10.jpg saved to cache
2025-12-05 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2b2cd0>
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F365faf96-a87b-4a0e-a7af-99a78070f914_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_4.jpg saved to cache
2025-12-05 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640c38d0>
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_19.jpg HTTP/1.1" 201 0
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-21085-4009700-1005.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-21085-4009700-1005.jpg saved to cache
2025-12-05 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee
2025-12-05 20:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-21085-4009700-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000021085-01987611-002.pdf)
2025-12-05 20:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000021085-01987611-002.pdf)
2025-12-05 20:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-21085-4009700-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000021085-01987611-002.pdf)
2025-12-05 20:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000021085-01987611-002.pdf)
2025-12-05 20:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000021085-01987611-002.pdf)
2025-12-05 20:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000021085-01987611-002.pdf)
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc65b36710>
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-21085-4009700-1000.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-21085-4009700-1000.jpg saved to cache
2025-12-05 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2fa210>
2025-12-05 20:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-21085-4009700-13.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-21085-4009700-13.jpg saved to cache
2025-12-05 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee
2025-12-05 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-21085-4009700-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000021085-01987611-002.pdf)
2025-12-05 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-21085-4009700-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000021085-01987611-002.pdf)
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6403f050>
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_18.jpg HTTP/1.1" 201 0
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-21085-4009700-1004.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-21085-4009700-1004.jpg saved to cache
2025-12-05 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64598910>
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F365faf96-a87b-4a0e-a7af-99a78070f914_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_3.jpg saved to cache
2025-12-05 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2cea90>
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_17.jpg HTTP/1.1" 201 0
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-21085-4009700-1003.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-21085-4009700-1003.jpg saved to cache
2025-12-05 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc645982d0>
2025-12-05 20:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F365faf96-a87b-4a0e-a7af-99a78070f914_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_5.jpg saved to cache
2025-12-05 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fb8cc90>
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F365faf96-a87b-4a0e-a7af-99a78070f914_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_2.jpg saved to cache
2025-12-05 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64618d50>
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F365faf96-a87b-4a0e-a7af-99a78070f914_9.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_9.jpg saved to cache
2025-12-05 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6445b8d0>
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_15.jpg HTTP/1.1" 201 0
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-21085-4009700-1001.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-21085-4009700-1001.jpg saved to cache
2025-12-05 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6406c7d0>
2025-12-05 20:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_16.jpg HTTP/1.1" 201 0
2025-12-05 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-21085-4009700-1002.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-21085-4009700-1002.jpg saved to cache
2025-12-05 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee
2025-12-05 20:02:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee, skipping ID generation
2025-12-05 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee from tracking dictionaries
2025-12-05 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee sending to next pipeline
2025-12-05 20:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee, identifier: 21085
2025-12-05 20:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee with identifier: 21085
2025-12-05 20:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee with identifier: 21085
2025-12-05 20:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 12 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
12
2025-12-05 20:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee spider: manheim.gb
2025-12-05 20:02:42 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee due to rule: registration_date_old.json, error: 12 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
12
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_expert_report_file_f3817d35-5c4f-4e79-ba18-b974938b39e9.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0000021085-01987611-002.pdf',
'color': 'GREY',
'currency': 'GBP',
'engine': '1.2L',
'expiration_date': '2025-12-08T09:00:00Z',
'fuel_type': 'Petrol',
'id': '6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MA63XTU',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/208?id=21085',
'listing': 'auction',
'location': 'Leeds',
'make': 'PEUGEOT',
'model': '208',
'odometer': 86829,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216562,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216562,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242548,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 240817,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168459,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 185891,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 165009,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 191660,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199817,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 255714,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216868,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 202143,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196607,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/365faf96-a87b-4a0e-a7af-99a78070f914_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402400,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-21085-4009700-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309865,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-21085-4009700-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291186,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-21085-4009700-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355388,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-21085-4009700-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 200218,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-21085-4009700-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 373857,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-21085-4009700-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee/6ae8c3a8-e2cb-57dd-a2e1-1b9458acd5ee_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239196,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-21085-4009700-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-31',
'seller_name': 'Stellantis & You',
'title': 'PEUGEOT 208 1.2 e-VTi Allure 5dr EGC',
'transmission': 'automatic',
'trim': '1.2 e-VTi Allure 5dr EGC',
'year': 2013}
2025-12-05 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%2721085%27 HTTP/1.1" 200 None
2025-12-05 20:02:42 [manheim.gb] INFO: Saving data for 21085: {'created_time': 1764964962.719779, 'last_price_update_time': 1764964962.719791, 'auction_closing_time': 1765184400.0}
2025-12-05 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='21085') HTTP/1.1" 204 0
2025-12-05 20:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002392879-01991745-002.pdf> (referer: None)
2025-12-05 20:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002390902-01994184-001.pdf> (referer: None)
2025-12-05 20:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6406c250>
2025-12-05 20:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_expert_report_file_70e25f04-1948-4b90-b338-3c4a9c2583e6.pdf HTTP/1.1" 201 0
2025-12-05 20:02:43 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 315bc698-72b6-5d57-8d26-758a555a1575
2025-12-05 20:02:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 315bc698-72b6-5d57-8d26-758a555a1575, skipping ID generation
2025-12-05 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 315bc698-72b6-5d57-8d26-758a555a1575
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_7.jpg not downloaded yet
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_7.jpg not downloaded yet
2025-12-05 20:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fbe3790>
2025-12-05 20:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_expert_report_file_1d5898c3-dff2-4185-a471-3808c5f5577f.pdf HTTP/1.1" 201 0
2025-12-05 20:02:43 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5bda70b0-ec23-578b-aebc-93b4bbdf9c49
2025-12-05 20:02:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5bda70b0-ec23-578b-aebc-93b4bbdf9c49, skipping ID generation
2025-12-05 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 5bda70b0-ec23-578b-aebc-93b4bbdf9c49
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_7.jpg not downloaded yet
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_6.jpg not downloaded yet
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_7.jpg not downloaded yet
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_1.jpg not downloaded yet
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_6.jpg not downloaded yet
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6ab7c5f0-7f5d-458a-95e2-11811a8c265b_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_5.jpg not downloaded yet
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_1.jpg not downloaded yet
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6ab7c5f0-7f5d-458a-95e2-11811a8c265b_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_4.jpg not downloaded yet
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7da6bdd4-82e0-4988-aafc-57bdd5cf1535_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_5.jpg not downloaded yet
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6ab7c5f0-7f5d-458a-95e2-11811a8c265b_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_11.jpg not downloaded yet
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7da6bdd4-82e0-4988-aafc-57bdd5cf1535_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_4.jpg not downloaded yet
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6ab7c5f0-7f5d-458a-95e2-11811a8c265b_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_10.jpg not downloaded yet
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7da6bdd4-82e0-4988-aafc-57bdd5cf1535_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_11.jpg not downloaded yet
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6ab7c5f0-7f5d-458a-95e2-11811a8c265b_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_9.jpg not downloaded yet
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7da6bdd4-82e0-4988-aafc-57bdd5cf1535_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_10.jpg not downloaded yet
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_2.jpg not downloaded yet
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7da6bdd4-82e0-4988-aafc-57bdd5cf1535_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_9.jpg not downloaded yet
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_5.jpg not downloaded yet
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_2.jpg not downloaded yet
2025-12-05 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_3.jpg not downloaded yet
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_5.jpg not downloaded yet
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_4.jpg not downloaded yet
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_3.jpg not downloaded yet
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2392879-4009479-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2392879-4009479-13.jpg not downloaded yet
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_4.jpg not downloaded yet
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2392879-4009479-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2392879-4009479-1000.jpg not downloaded yet
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2390902-4010292-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2390902-4010292-13.jpg not downloaded yet
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2392879-4009479-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2392879-4009479-1001.jpg not downloaded yet
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2390902-4010292-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2390902-4010292-1000.jpg not downloaded yet
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2392879-4009479-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2392879-4009479-1002.jpg not downloaded yet
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2390902-4010292-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2390902-4010292-1001.jpg not downloaded yet
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2392879-4009479-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2392879-4009479-1003.jpg not downloaded yet
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2390902-4010292-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2390902-4010292-1002.jpg not downloaded yet
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2392879-4009479-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2392879-4009479-1004.jpg not downloaded yet
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2390902-4010292-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2390902-4010292-1003.jpg not downloaded yet
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2392879-4009479-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2392879-4009479-1005.jpg not downloaded yet
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2390902-4010292-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2390902-4010292-1004.jpg not downloaded yet
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2390902-4010292-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2390902-4010292-1005.jpg not downloaded yet
2025-12-05 20:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2390902-4010292-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002390902-01994184-001.pdf)
2025-12-05 20:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2392879-4009479-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002392879-01991745-002.pdf)
2025-12-05 20:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2392879-4009479-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002392879-01991745-002.pdf)
2025-12-05 20:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6432a210>
2025-12-05 20:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_18.jpg HTTP/1.1" 201 0
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2390902-4010292-1004.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2390902-4010292-1004.jpg saved to cache
2025-12-05 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 5bda70b0-ec23-578b-aebc-93b4bbdf9c49
2025-12-05 20:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2392879-4009479-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002392879-01991745-002.pdf)
2025-12-05 20:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2390902-4010292-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002390902-01994184-001.pdf)
2025-12-05 20:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MINI/COUNTRYMAN?id=2636985&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232636985&indx=142> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2390902-4010292-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002390902-01994184-001.pdf)
2025-12-05 20:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2390902-4010292-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002390902-01994184-001.pdf)
2025-12-05 20:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2390902-4010292-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002390902-01994184-001.pdf)
2025-12-05 20:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6443c3d0>
2025-12-05 20:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_18.jpg HTTP/1.1" 201 0
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2392879-4009479-1004.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2392879-4009479-1004.jpg saved to cache
2025-12-05 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 315bc698-72b6-5d57-8d26-758a555a1575
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc644d9d90>
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_19.jpg HTTP/1.1" 201 0
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2392879-4009479-1005.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2392879-4009479-1005.jpg saved to cache
2025-12-05 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 315bc698-72b6-5d57-8d26-758a555a1575
2025-12-05 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/MONDEO?id=2413019&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232413019&indx=110> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2390902-4010292-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002390902-01994184-001.pdf)
2025-12-05 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2392879-4009479-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002392879-01991745-002.pdf)
2025-12-05 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2392879-4009479-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002392879-01991745-002.pdf)
2025-12-05 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2390902-4010292-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002390902-01994184-001.pdf)
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64599690>
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_17.jpg HTTP/1.1" 201 0
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2392879-4009479-1003.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2392879-4009479-1003.jpg saved to cache
2025-12-05 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 315bc698-72b6-5d57-8d26-758a555a1575
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2b19d0>
2025-12-05 20:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_17.jpg HTTP/1.1" 201 0
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2390902-4010292-1003.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2390902-4010292-1003.jpg saved to cache
2025-12-05 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 5bda70b0-ec23-578b-aebc-93b4bbdf9c49
2025-12-05 20:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdab9c25-edd7-5644-9efd-aa77419fa709 with identifier: 2636985
2025-12-05 20:02:46 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item fdab9c25-edd7-5644-9efd-aa77419fa709
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640f1010>
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_15.jpg HTTP/1.1" 201 0
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2390902-4010292-1001.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2390902-4010292-1001.jpg saved to cache
2025-12-05 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 5bda70b0-ec23-578b-aebc-93b4bbdf9c49
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2b39d0>
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_16.jpg HTTP/1.1" 201 0
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2390902-4010292-1002.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2390902-4010292-1002.jpg saved to cache
2025-12-05 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 5bda70b0-ec23-578b-aebc-93b4bbdf9c49
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc643ddb10>
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2390902-4010292-1000.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2390902-4010292-1000.jpg saved to cache
2025-12-05 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 5bda70b0-ec23-578b-aebc-93b4bbdf9c49
2025-12-05 20:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MAZDA/2?id=2544324&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232544324&indx=126> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2392879-4009479-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002392879-01991745-002.pdf)
2025-12-05 20:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002392879-01991745-002.pdf)
2025-12-05 20:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43 with identifier: 2413019
2025-12-05 20:02:46 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e51a990>
2025-12-05 20:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_19.jpg HTTP/1.1" 201 0
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2390902-4010292-1005.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2390902-4010292-1005.jpg saved to cache
2025-12-05 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 5bda70b0-ec23-578b-aebc-93b4bbdf9c49
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc641c2790>
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_16.jpg HTTP/1.1" 201 0
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2392879-4009479-1002.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2392879-4009479-1002.jpg saved to cache
2025-12-05 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 315bc698-72b6-5d57-8d26-758a555a1575
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6428b810>
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_15.jpg HTTP/1.1" 201 0
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2392879-4009479-1001.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2392879-4009479-1001.jpg saved to cache
2025-12-05 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 315bc698-72b6-5d57-8d26-758a555a1575
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640c2d90>
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2390902-4010292-13.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2390902-4010292-13.jpg saved to cache
2025-12-05 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 5bda70b0-ec23-578b-aebc-93b4bbdf9c49
2025-12-05 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002390902-01994184-001.pdf)
2025-12-05 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002390902-01994184-001.pdf)
2025-12-05 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002390902-01994184-001.pdf)
2025-12-05 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002392879-01991745-002.pdf)
2025-12-05 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2392879-4009479-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002392879-01991745-002.pdf)
2025-12-05 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002392879-01991745-002.pdf)
2025-12-05 20:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acde8cdf-4f5b-5251-b421-33fff451423c with identifier: 2544324
2025-12-05 20:02:47 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item acde8cdf-4f5b-5251-b421-33fff451423c
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640ed210>
2025-12-05 20:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2392879-4009479-1000.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2392879-4009479-1000.jpg saved to cache
2025-12-05 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 315bc698-72b6-5d57-8d26-758a555a1575
2025-12-05 20:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64402510>
2025-12-05 20:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_3.jpg saved to cache
2025-12-05 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 315bc698-72b6-5d57-8d26-758a555a1575
2025-12-05 20:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002390902-01994184-001.pdf)
2025-12-05 20:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6403d1d0>
2025-12-05 20:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_4.jpg saved to cache
2025-12-05 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 5bda70b0-ec23-578b-aebc-93b4bbdf9c49
2025-12-05 20:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc641b9f10>
2025-12-05 20:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_3.jpg saved to cache
2025-12-05 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 5bda70b0-ec23-578b-aebc-93b4bbdf9c49
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640d05d0>
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_5.jpg saved to cache
2025-12-05 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 5bda70b0-ec23-578b-aebc-93b4bbdf9c49
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc643dd4d0>
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_4.jpg saved to cache
2025-12-05 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 315bc698-72b6-5d57-8d26-758a555a1575
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6419f010>
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2392879-4009479-13.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2392879-4009479-13.jpg saved to cache
2025-12-05 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 315bc698-72b6-5d57-8d26-758a555a1575
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64546090>
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_5.jpg saved to cache
2025-12-05 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 315bc698-72b6-5d57-8d26-758a555a1575
2025-12-05 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002390902-01994184-001.pdf)
2025-12-05 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002392879-01991745-002.pdf)
2025-12-05 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002392879-01991745-002.pdf)
2025-12-05 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002392879-01991745-002.pdf)
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc643d1010>
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_2.jpg saved to cache
2025-12-05 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5bda70b0-ec23-578b-aebc-93b4bbdf9c49
2025-12-05 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002390902-01994184-001.pdf)
2025-12-05 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002390902-01994184-001.pdf)
2025-12-05 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002390902-01994184-001.pdf)
2025-12-05 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002392879-01991745-002.pdf)
2025-12-05 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002390902-01994184-001.pdf)
2025-12-05 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002392879-01991745-002.pdf)
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6407b250>
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7da6bdd4-82e0-4988-aafc-57bdd5cf1535_9.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_9.jpg saved to cache
2025-12-05 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5bda70b0-ec23-578b-aebc-93b4bbdf9c49
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6428a210>
2025-12-05 20:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6ab7c5f0-7f5d-458a-95e2-11811a8c265b_10.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_10.jpg saved to cache
2025-12-05 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 315bc698-72b6-5d57-8d26-758a555a1575
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6428b2d0>
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_2.jpg saved to cache
2025-12-05 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 315bc698-72b6-5d57-8d26-758a555a1575
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6428b750>
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6ab7c5f0-7f5d-458a-95e2-11811a8c265b_9.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_9.jpg saved to cache
2025-12-05 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 315bc698-72b6-5d57-8d26-758a555a1575
2025-12-05 20:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/C4GRANDSPACETOURER?id=2599853&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232599853&indx=138> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002390902-01994184-001.pdf)
2025-12-05 20:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002392879-01991745-002.pdf)
2025-12-05 20:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002392879-01991745-002.pdf)
2025-12-05 20:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002390902-01994184-001.pdf)
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6446e150>
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7da6bdd4-82e0-4988-aafc-57bdd5cf1535_11.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_11.jpg saved to cache
2025-12-05 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5bda70b0-ec23-578b-aebc-93b4bbdf9c49
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6446c490>
2025-12-05 20:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7da6bdd4-82e0-4988-aafc-57bdd5cf1535_10.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_10.jpg saved to cache
2025-12-05 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5bda70b0-ec23-578b-aebc-93b4bbdf9c49
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6446c350>
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7da6bdd4-82e0-4988-aafc-57bdd5cf1535_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_4.jpg saved to cache
2025-12-05 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5bda70b0-ec23-578b-aebc-93b4bbdf9c49
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6446c290>
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6ab7c5f0-7f5d-458a-95e2-11811a8c265b_11.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_11.jpg saved to cache
2025-12-05 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 315bc698-72b6-5d57-8d26-758a555a1575
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640b7e10>
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7da6bdd4-82e0-4988-aafc-57bdd5cf1535_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_5.jpg saved to cache
2025-12-05 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5bda70b0-ec23-578b-aebc-93b4bbdf9c49
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6446f9d0>
2025-12-05 20:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6ab7c5f0-7f5d-458a-95e2-11811a8c265b_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_4.jpg saved to cache
2025-12-05 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 315bc698-72b6-5d57-8d26-758a555a1575
2025-12-05 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002390902-01994184-001.pdf)
2025-12-05 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002392879-01991745-002.pdf)
2025-12-05 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002392879-01991745-002.pdf)
2025-12-05 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002390902-01994184-001.pdf)
2025-12-05 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002392879-01991745-002.pdf)
2025-12-05 20:02:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5144487c-74f1-57ec-97c4-bbdafdf8c1c3 with identifier: 2599853
2025-12-05 20:02:53 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5144487c-74f1-57ec-97c4-bbdafdf8c1c3
2025-12-05 20:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2f9b10>
2025-12-05 20:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_1.jpg saved to cache
2025-12-05 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5bda70b0-ec23-578b-aebc-93b4bbdf9c49
2025-12-05 20:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc642cb110>
2025-12-05 20:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_6.jpg saved to cache
2025-12-05 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 315bc698-72b6-5d57-8d26-758a555a1575
2025-12-05 20:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64085ad0>
2025-12-05 20:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6ab7c5f0-7f5d-458a-95e2-11811a8c265b_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_5.jpg saved to cache
2025-12-05 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 315bc698-72b6-5d57-8d26-758a555a1575
2025-12-05 20:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e52ba90>
2025-12-05 20:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_7.jpg saved to cache
2025-12-05 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5bda70b0-ec23-578b-aebc-93b4bbdf9c49
2025-12-05 20:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64273cd0>
2025-12-05 20:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_6.jpg saved to cache
2025-12-05 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5bda70b0-ec23-578b-aebc-93b4bbdf9c49
2025-12-05 20:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fbd5550>
2025-12-05 20:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_1.jpg saved to cache
2025-12-05 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 315bc698-72b6-5d57-8d26-758a555a1575
2025-12-05 20:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fbf3510>
2025-12-05 20:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_7.jpg saved to cache
2025-12-05 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 315bc698-72b6-5d57-8d26-758a555a1575
2025-12-05 20:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc644ff050>
2025-12-05 20:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_7.jpg saved to cache
2025-12-05 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5bda70b0-ec23-578b-aebc-93b4bbdf9c49
2025-12-05 20:02:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5bda70b0-ec23-578b-aebc-93b4bbdf9c49, skipping ID generation
2025-12-05 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5bda70b0-ec23-578b-aebc-93b4bbdf9c49 from tracking dictionaries
2025-12-05 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5bda70b0-ec23-578b-aebc-93b4bbdf9c49 sending to next pipeline
2025-12-05 20:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 5bda70b0-ec23-578b-aebc-93b4bbdf9c49, identifier: 2390902
2025-12-05 20:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2f3cd0>
2025-12-05 20:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_7.jpg saved to cache
2025-12-05 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 315bc698-72b6-5d57-8d26-758a555a1575
2025-12-05 20:02:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 315bc698-72b6-5d57-8d26-758a555a1575, skipping ID generation
2025-12-05 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 315bc698-72b6-5d57-8d26-758a555a1575 from tracking dictionaries
2025-12-05 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 315bc698-72b6-5d57-8d26-758a555a1575 sending to next pipeline
2025-12-05 20:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 315bc698-72b6-5d57-8d26-758a555a1575, identifier: 2392879
2025-12-05 20:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 5bda70b0-ec23-578b-aebc-93b4bbdf9c49 with identifier: 2390902
2025-12-05 20:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 5bda70b0-ec23-578b-aebc-93b4bbdf9c49 with identifier: 2390902
2025-12-05 20:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 5bda70b0-ec23-578b-aebc-93b4bbdf9c49 with identifier: 2390902 to the API
2025-12-05 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:02:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_expert_report_file_1d5898c3-dff2-4185-a471-3808c5f5577f.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002390902-01994184-001.pdf',
'color': 'BLACK',
'currency': 'GBP',
'engine': '1.3L',
'expiration_date': '2025-12-09T09:00:00Z',
'fuel_type': 'Petrol',
'id': '5bda70b0-ec23-578b-aebc-93b4bbdf9c49',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LP19FPV',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/A%20CLASS?id=2390902',
'listing': 'auction',
'location': 'Northampton',
'make': 'MERCEDES-BENZ',
'model': 'A CLASS',
'odometer': 57336,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 40,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 225014,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 225014,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273451,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 167407,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223478,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 219370,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 221221,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 219990,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 231235,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310885,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 270271,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 282197,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284688,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7da6bdd4-82e0-4988-aafc-57bdd5cf1535_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 234713,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2390902-4010292-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184128,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2390902-4010292-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 206700,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2390902-4010292-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192269,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2390902-4010292-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 162020,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2390902-4010292-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 170690,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2390902-4010292-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bda70b0-ec23-578b-aebc-93b4bbdf9c49/5bda70b0-ec23-578b-aebc-93b4bbdf9c49_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347960,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2390902-4010292-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-21',
'seller_name': 'Sytner',
'title': 'MERCEDES-BENZ A CLASS A180 Sport Executive 5dr Auto',
'transmission': 'automatic',
'trim': 'A180 Sport Executive 5dr Auto',
'year': 2019}
2025-12-05 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272390902%27 HTTP/1.1" 200 None
2025-12-05 20:02:57 [manheim.gb] INFO: Saving data for 2390902: {'created_time': 1764964977.851892, 'last_price_update_time': 1764964977.851902, 'auction_closing_time': 1765270800.0}
2025-12-05 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2390902') HTTP/1.1" 204 0
2025-12-05 20:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 315bc698-72b6-5d57-8d26-758a555a1575 with identifier: 2392879
2025-12-05 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:02:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol%2FHybrid HTTP/1.1" 200 None
2025-12-05 20:02:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 315bc698-72b6-5d57-8d26-758a555a1575 with identifier: 2392879
2025-12-05 20:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 151773 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
151773
2025-12-05 20:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 315bc698-72b6-5d57-8d26-758a555a1575 spider: manheim.gb
2025-12-05 20:02:58 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 315bc698-72b6-5d57-8d26-758a555a1575 due to rule: high_mileage_for_country.json, error: 151773 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
151773
{'auction_title': '',
'c_o_2_emission_value': 38,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_expert_report_file_70e25f04-1948-4b90-b338-3c4a9c2583e6.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002392879-01991745-002.pdf',
'color': 'BLACK',
'currency': 'GBP',
'engine': '1.4L',
'expiration_date': '2025-12-10T09:00:00Z',
'fuel_type': 'Petrol/Hybrid',
'id': '315bc698-72b6-5d57-8d26-758a555a1575',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NL67JVF',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=2392879',
'listing': 'auction',
'location': 'Plymouth',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 94308,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 30,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 205089,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 205089,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 218148,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263264,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 207090,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 205732,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204996,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204582,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199068,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304489,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260769,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 256491,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272721,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6ab7c5f0-7f5d-458a-95e2-11811a8c265b_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335866,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2392879-4009479-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 476709,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2392879-4009479-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376144,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2392879-4009479-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382537,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2392879-4009479-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388423,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2392879-4009479-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341723,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2392879-4009479-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315bc698-72b6-5d57-8d26-758a555a1575/315bc698-72b6-5d57-8d26-758a555a1575_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326363,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2392879-4009479-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-06',
'seller_name': 'Yeomans',
'title': 'VOLKSWAGEN GOLF 1.4 TSI GTE 5dr DSG',
'transmission': 'automatic',
'trim': '1.4 TSI GTE 5dr DSG',
'year': 2017}
2025-12-05 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272392879%27 HTTP/1.1" 200 None
2025-12-05 20:02:58 [manheim.gb] INFO: Saving data for 2392879: {'created_time': 1764964978.246847, 'last_price_update_time': 1764964978.246858, 'auction_closing_time': 1765357200.0}
2025-12-05 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2392879') HTTP/1.1" 204 0
2025-12-05 20:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MAZDA/CX5?id=2606673&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232606673&indx=139> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/AUDI/A3?id=2597131&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232597131&indx=137> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 20:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002544324-01988922-003.pdf> (referer: None)
2025-12-05 20:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002636985-01993703-002.pdf> (referer: None)
2025-12-05 20:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002413019-01994468-002.pdf> (referer: None)
2025-12-05 20:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002599853-01993349-001.pdf> (referer: None)
2025-12-05 20:02:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 591f2d53-8462-59fd-a965-443e232a08fb with identifier: 2606673
2025-12-05 20:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 591f2d53-8462-59fd-a965-443e232a08fb with scrape type 2
2025-12-05 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 591f2d53-8462-59fd-a965-443e232a08fb with scrape type 2
2025-12-05 20:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 591f2d53-8462-59fd-a965-443e232a08fb, identifier: 2606673
2025-12-05 20:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 591f2d53-8462-59fd-a965-443e232a08fb with identifier: 2606673
2025-12-05 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:02:58 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=RED HTTP/1.1" 200 None
2025-12-05 20:02:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 591f2d53-8462-59fd-a965-443e232a08fb with identifier: 2606673
2025-12-05 20:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 188476 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
188476
2025-12-05 20:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 591f2d53-8462-59fd-a965-443e232a08fb spider: manheim.gb
2025-12-05 20:02:58 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 591f2d53-8462-59fd-a965-443e232a08fb due to rule: high_mileage_for_country.json, error: 188476 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
188476
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002606673-01991003-002.pdf',
'color': 'RED',
'currency': 'GBP',
'engine': '2.2L',
'expiration_date': '2025-12-08T09:00:00Z',
'fuel_type': 'Diesel',
'id': '591f2d53-8462-59fd-a965-443e232a08fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YR17WNS',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MAZDA/CX-5?id=2606673',
'listing': 'auction',
'location': 'Leeds',
'make': 'MAZDA',
'model': 'CX-5',
'odometer': 117114,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-28',
'seller_name': 'Big Motoring World Ltd',
'title': 'MAZDA CX-5 2.2d Sport Nav 5dr',
'transmission': 'manual',
'trim': '2.2d Sport Nav 5dr',
'year': 2017}
2025-12-05 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272606673%27 HTTP/1.1" 200 None
2025-12-05 20:02:58 [manheim.gb] INFO: Saving data for 2606673: {'auction_closing_time': 1765184400.0, 'created_time': 1764842623.602396, 'last_price_update_time': 1764964978.872338}
2025-12-05 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2606673') HTTP/1.1" 204 0
2025-12-05 20:02:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6124836e-0bc9-58a0-92f9-719ef4ff9395 with identifier: 2597131
2025-12-05 20:02:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6124836e-0bc9-58a0-92f9-719ef4ff9395
2025-12-05 20:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc641e4c10>
2025-12-05 20:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_expert_report_file_1eb72f2c-c27d-46dc-b8bb-ff48f767dce6.pdf HTTP/1.1" 201 0
2025-12-05 20:02:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item acde8cdf-4f5b-5251-b421-33fff451423c
2025-12-05 20:02:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: acde8cdf-4f5b-5251-b421-33fff451423c, skipping ID generation
2025-12-05 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item acde8cdf-4f5b-5251-b421-33fff451423c
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fec16ee45-7133-4126-b9b8-b205018d3604_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_7.jpg not downloaded yet
2025-12-05 20:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc644c5d90>
2025-12-05 20:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_expert_report_file_54d70be9-74b8-4ceb-8ff7-1dc5334968c8.pdf HTTP/1.1" 201 0
2025-12-05 20:02:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item fdab9c25-edd7-5644-9efd-aa77419fa709
2025-12-05 20:02:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fdab9c25-edd7-5644-9efd-aa77419fa709, skipping ID generation
2025-12-05 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item fdab9c25-edd7-5644-9efd-aa77419fa709
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_7.jpg not downloaded yet
2025-12-05 20:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fb80cd0>
2025-12-05 20:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_expert_report_file_28af5312-86f1-4524-b3d3-cf32e2a612f9.pdf HTTP/1.1" 201 0
2025-12-05 20:02:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43
2025-12-05 20:02:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43, skipping ID generation
2025-12-05 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F394853e7-adb5-4621-8060-e61d2b6a100a_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_7.jpg not downloaded yet
2025-12-05 20:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc643de310>
2025-12-05 20:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_expert_report_file_e50fd7c1-a4e2-4f73-83e9-0d39a57201ce.pdf HTTP/1.1" 201 0
2025-12-05 20:03:00 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5144487c-74f1-57ec-97c4-bbdafdf8c1c3
2025-12-05 20:03:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5144487c-74f1-57ec-97c4-bbdafdf8c1c3, skipping ID generation
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 5144487c-74f1-57ec-97c4-bbdafdf8c1c3
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_7.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fec16ee45-7133-4126-b9b8-b205018d3604_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_7.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_7.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F394853e7-adb5-4621-8060-e61d2b6a100a_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_7.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_7.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fec16ee45-7133-4126-b9b8-b205018d3604_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_6.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_6.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F394853e7-adb5-4621-8060-e61d2b6a100a_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_6.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_6.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fec16ee45-7133-4126-b9b8-b205018d3604_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_1.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_1.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F394853e7-adb5-4621-8060-e61d2b6a100a_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_1.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_1.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fec16ee45-7133-4126-b9b8-b205018d3604_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_5.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d430913-ce2f-4e1f-bd99-a06d153c601f_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_5.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F394853e7-adb5-4621-8060-e61d2b6a100a_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_5.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F83c40963-edd7-4567-a6a2-f202d7b7e0ad_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_5.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fec16ee45-7133-4126-b9b8-b205018d3604_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_4.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d430913-ce2f-4e1f-bd99-a06d153c601f_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_4.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F394853e7-adb5-4621-8060-e61d2b6a100a_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_4.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F83c40963-edd7-4567-a6a2-f202d7b7e0ad_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_4.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fec16ee45-7133-4126-b9b8-b205018d3604_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_11.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d430913-ce2f-4e1f-bd99-a06d153c601f_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_11.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F394853e7-adb5-4621-8060-e61d2b6a100a_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_11.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F83c40963-edd7-4567-a6a2-f202d7b7e0ad_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_11.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fec16ee45-7133-4126-b9b8-b205018d3604_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_10.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d430913-ce2f-4e1f-bd99-a06d153c601f_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_10.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F394853e7-adb5-4621-8060-e61d2b6a100a_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_10.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F83c40963-edd7-4567-a6a2-f202d7b7e0ad_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_10.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fec16ee45-7133-4126-b9b8-b205018d3604_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_9.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d430913-ce2f-4e1f-bd99-a06d153c601f_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_9.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F394853e7-adb5-4621-8060-e61d2b6a100a_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_9.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F83c40963-edd7-4567-a6a2-f202d7b7e0ad_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_9.jpg not downloaded yet
2025-12-05 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fec16ee45-7133-4126-b9b8-b205018d3604_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_2.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_2.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F394853e7-adb5-4621-8060-e61d2b6a100a_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_2.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_2.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fec16ee45-7133-4126-b9b8-b205018d3604_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_5.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_5.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F394853e7-adb5-4621-8060-e61d2b6a100a_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_5.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_5.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fec16ee45-7133-4126-b9b8-b205018d3604_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_3.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_3.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F394853e7-adb5-4621-8060-e61d2b6a100a_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_3.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_3.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fec16ee45-7133-4126-b9b8-b205018d3604_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_4.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_4.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F394853e7-adb5-4621-8060-e61d2b6a100a_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_4.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_4.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2544324-4009293-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2544324-4009293-13.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2636985-4009658-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2636985-4009658-13.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2413019-4009542-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2413019-4009542-13.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2599853-4010403-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2599853-4010403-13.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2544324-4009293-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2544324-4009293-1000.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2636985-4009658-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2636985-4009658-1000.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2413019-4009542-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2413019-4009542-1000.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2599853-4010403-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2599853-4010403-1000.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2544324-4009293-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2544324-4009293-1001.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2636985-4009658-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2636985-4009658-1001.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2413019-4009542-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2413019-4009542-1001.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2599853-4010403-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2599853-4010403-1001.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2544324-4009293-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2544324-4009293-1002.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2636985-4009658-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2636985-4009658-1002.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2413019-4009542-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2413019-4009542-1002.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2599853-4010403-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2599853-4010403-1002.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2544324-4009293-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2544324-4009293-1003.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2636985-4009658-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2636985-4009658-1003.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2413019-4009542-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2413019-4009542-1003.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2599853-4010403-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2599853-4010403-1003.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2544324-4009293-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2544324-4009293-1004.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2636985-4009658-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2636985-4009658-1004.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2413019-4009542-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2413019-4009542-1004.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2599853-4010403-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2599853-4010403-1004.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2544324-4009293-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2544324-4009293-1005.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2636985-4009658-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2636985-4009658-1005.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2413019-4009542-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2413019-4009542-1005.jpg not downloaded yet
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2599853-4010403-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2599853-4010403-1005.jpg not downloaded yet
2025-12-05 20:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2599853-4010403-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002599853-01993349-001.pdf)
2025-12-05 20:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2599853-4010403-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002599853-01993349-001.pdf)
2025-12-05 20:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2544324-4009293-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002544324-01988922-003.pdf)
2025-12-05 20:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2544324-4009293-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002544324-01988922-003.pdf)
2025-12-05 20:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2169d0>
2025-12-05 20:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_18.jpg HTTP/1.1" 201 0
2025-12-05 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2599853-4010403-1004.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2599853-4010403-1004.jpg saved to cache
2025-12-05 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 5144487c-74f1-57ec-97c4-bbdafdf8c1c3
2025-12-05 20:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2636985-4009658-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002636985-01993703-002.pdf)
2025-12-05 20:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2636985-4009658-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002636985-01993703-002.pdf)
2025-12-05 20:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fbf7210>
2025-12-05 20:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_19.jpg HTTP/1.1" 201 0
2025-12-05 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2599853-4010403-1005.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2599853-4010403-1005.jpg saved to cache
2025-12-05 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 5144487c-74f1-57ec-97c4-bbdafdf8c1c3
2025-12-05 20:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc65a03bd0>
2025-12-05 20:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_18.jpg HTTP/1.1" 201 0
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2544324-4009293-1004.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2544324-4009293-1004.jpg saved to cache
2025-12-05 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item acde8cdf-4f5b-5251-b421-33fff451423c
2025-12-05 20:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc641e4c90>
2025-12-05 20:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_19.jpg HTTP/1.1" 201 0
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2544324-4009293-1005.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2544324-4009293-1005.jpg saved to cache
2025-12-05 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item acde8cdf-4f5b-5251-b421-33fff451423c
2025-12-05 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2413019-4009542-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002413019-01994468-002.pdf)
2025-12-05 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2413019-4009542-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002413019-01994468-002.pdf)
2025-12-05 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2636985-4009658-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002636985-01993703-002.pdf)
2025-12-05 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2599853-4010403-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002599853-01993349-001.pdf)
2025-12-05 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2413019-4009542-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002413019-01994468-002.pdf)
2025-12-05 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2544324-4009293-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002544324-01988922-003.pdf)
2025-12-05 20:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc643fb490>
2025-12-05 20:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_19.jpg HTTP/1.1" 201 0
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2636985-4009658-1005.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2636985-4009658-1005.jpg saved to cache
2025-12-05 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item fdab9c25-edd7-5644-9efd-aa77419fa709
2025-12-05 20:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64185410>
2025-12-05 20:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_17.jpg HTTP/1.1" 201 0
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2636985-4009658-1003.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2636985-4009658-1003.jpg saved to cache
2025-12-05 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item fdab9c25-edd7-5644-9efd-aa77419fa709
2025-12-05 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2599853-4010403-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002599853-01993349-001.pdf)
2025-12-05 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2636985-4009658-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002636985-01993703-002.pdf)
2025-12-05 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2636985-4009658-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002636985-01993703-002.pdf)
2025-12-05 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2413019-4009542-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002413019-01994468-002.pdf)
2025-12-05 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2599853-4010403-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002599853-01993349-001.pdf)
2025-12-05 20:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64253610>
2025-12-05 20:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_19.jpg HTTP/1.1" 201 0
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2413019-4009542-1005.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2413019-4009542-1005.jpg saved to cache
2025-12-05 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43
2025-12-05 20:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6450add0>
2025-12-05 20:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_18.jpg HTTP/1.1" 201 0
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2413019-4009542-1004.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2413019-4009542-1004.jpg saved to cache
2025-12-05 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43
2025-12-05 20:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6446e350>
2025-12-05 20:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_18.jpg HTTP/1.1" 201 0
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2636985-4009658-1004.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2636985-4009658-1004.jpg saved to cache
2025-12-05 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item fdab9c25-edd7-5644-9efd-aa77419fa709
2025-12-05 20:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fba55d0>
2025-12-05 20:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_17.jpg HTTP/1.1" 201 0
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2599853-4010403-1003.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2599853-4010403-1003.jpg saved to cache
2025-12-05 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 5144487c-74f1-57ec-97c4-bbdafdf8c1c3
2025-12-05 20:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6446f350>
2025-12-05 20:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_17.jpg HTTP/1.1" 201 0
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2413019-4009542-1003.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2413019-4009542-1003.jpg saved to cache
2025-12-05 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43
2025-12-05 20:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64252090>
2025-12-05 20:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_17.jpg HTTP/1.1" 201 0
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2544324-4009293-1003.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2544324-4009293-1003.jpg saved to cache
2025-12-05 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item acde8cdf-4f5b-5251-b421-33fff451423c
2025-12-05 20:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2544324-4009293-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002544324-01988922-003.pdf)
2025-12-05 20:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2544324-4009293-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002544324-01988922-003.pdf)
2025-12-05 20:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2413019-4009542-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002413019-01994468-002.pdf)
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6443f390>
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_16.jpg HTTP/1.1" 201 0
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2599853-4010403-1002.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2599853-4010403-1002.jpg saved to cache
2025-12-05 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 5144487c-74f1-57ec-97c4-bbdafdf8c1c3
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc642b7810>
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_16.jpg HTTP/1.1" 201 0
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2636985-4009658-1002.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2636985-4009658-1002.jpg saved to cache
2025-12-05 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item fdab9c25-edd7-5644-9efd-aa77419fa709
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc641f5c90>
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_15.jpg HTTP/1.1" 201 0
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2636985-4009658-1001.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2636985-4009658-1001.jpg saved to cache
2025-12-05 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item fdab9c25-edd7-5644-9efd-aa77419fa709
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc643f8350>
2025-12-05 20:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_16.jpg HTTP/1.1" 201 0
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2413019-4009542-1002.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2413019-4009542-1002.jpg saved to cache
2025-12-05 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43
2025-12-05 20:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc642b6d90>
2025-12-05 20:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_15.jpg HTTP/1.1" 201 0
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2599853-4010403-1001.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2599853-4010403-1001.jpg saved to cache
2025-12-05 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 5144487c-74f1-57ec-97c4-bbdafdf8c1c3
2025-12-05 20:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2599853-4010403-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002599853-01993349-001.pdf)
2025-12-05 20:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6436c850>
2025-12-05 20:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_15.jpg HTTP/1.1" 201 0
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2544324-4009293-1001.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2544324-4009293-1001.jpg saved to cache
2025-12-05 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item acde8cdf-4f5b-5251-b421-33fff451423c
2025-12-05 20:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6436aa50>
2025-12-05 20:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_16.jpg HTTP/1.1" 201 0
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2544324-4009293-1002.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2544324-4009293-1002.jpg saved to cache
2025-12-05 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item acde8cdf-4f5b-5251-b421-33fff451423c
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc659a6390>
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_15.jpg HTTP/1.1" 201 0
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2413019-4009542-1001.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2413019-4009542-1001.jpg saved to cache
2025-12-05 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43
2025-12-05 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2544324-4009293-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002544324-01988922-003.pdf)
2025-12-05 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2636985-4009658-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002636985-01993703-002.pdf)
2025-12-05 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2413019-4009542-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002413019-01994468-002.pdf)
2025-12-05 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2544324-4009293-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002544324-01988922-003.pdf)
2025-12-05 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2636985-4009658-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002636985-01993703-002.pdf)
2025-12-05 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2599853-4010403-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002599853-01993349-001.pdf)
2025-12-05 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2413019-4009542-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002413019-01994468-002.pdf)
2025-12-05 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002599853-01993349-001.pdf)
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64165790>
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2599853-4010403-1000.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2599853-4010403-1000.jpg saved to cache
2025-12-05 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 5144487c-74f1-57ec-97c4-bbdafdf8c1c3
2025-12-05 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002636985-01993703-002.pdf)
2025-12-05 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002636985-01993703-002.pdf)
2025-12-05 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002599853-01993349-001.pdf)
2025-12-05 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002413019-01994468-002.pdf)
2025-12-05 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002544324-01988922-003.pdf)
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2198d0>
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2544324-4009293-1000.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2544324-4009293-1000.jpg saved to cache
2025-12-05 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item acde8cdf-4f5b-5251-b421-33fff451423c
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e4fed50>
2025-12-05 20:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2636985-4009658-1000.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2636985-4009658-1000.jpg saved to cache
2025-12-05 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item fdab9c25-edd7-5644-9efd-aa77419fa709
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc641ef710>
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2413019-4009542-1000.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2413019-4009542-1000.jpg saved to cache
2025-12-05 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64448210>
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2544324-4009293-13.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2544324-4009293-13.jpg saved to cache
2025-12-05 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item acde8cdf-4f5b-5251-b421-33fff451423c
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64627c90>
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2636985-4009658-13.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2636985-4009658-13.jpg saved to cache
2025-12-05 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item fdab9c25-edd7-5644-9efd-aa77419fa709
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc645acb50>
2025-12-05 20:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2599853-4010403-13.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2599853-4010403-13.jpg saved to cache
2025-12-05 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 5144487c-74f1-57ec-97c4-bbdafdf8c1c3
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fbdff90>
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2413019-4009542-13.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2413019-4009542-13.jpg saved to cache
2025-12-05 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6424b510>
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_4.jpg saved to cache
2025-12-05 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 5144487c-74f1-57ec-97c4-bbdafdf8c1c3
2025-12-05 20:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002413019-01994468-002.pdf)
2025-12-05 20:03:10 [scrapy.extensions.logstats] INFO: Crawled 59 pages (at 28 pages/min), scraped 8 items (at 4 items/min)
2025-12-05 20:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002544324-01988922-003.pdf)
2025-12-05 20:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002599853-01993349-001.pdf)
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640f2610>
2025-12-05 20:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_3.jpg saved to cache
2025-12-05 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item fdab9c25-edd7-5644-9efd-aa77419fa709
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc644fe550>
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_4.jpg saved to cache
2025-12-05 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item fdab9c25-edd7-5644-9efd-aa77419fa709
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64283310>
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_3.jpg saved to cache
2025-12-05 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 5144487c-74f1-57ec-97c4-bbdafdf8c1c3
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f230a50>
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F394853e7-adb5-4621-8060-e61d2b6a100a_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_3.jpg saved to cache
2025-12-05 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc644fdf50>
2025-12-05 20:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fec16ee45-7133-4126-b9b8-b205018d3604_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_4.jpg saved to cache
2025-12-05 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item acde8cdf-4f5b-5251-b421-33fff451423c
2025-12-05 20:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002544324-01988922-003.pdf)
2025-12-05 20:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002413019-01994468-002.pdf)
2025-12-05 20:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002599853-01993349-001.pdf)
2025-12-05 20:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002413019-01994468-002.pdf)
2025-12-05 20:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002544324-01988922-003.pdf)
2025-12-05 20:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002636985-01993703-002.pdf)
2025-12-05 20:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002636985-01993703-002.pdf)
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6432a210>
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F394853e7-adb5-4621-8060-e61d2b6a100a_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_4.jpg saved to cache
2025-12-05 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64219e50>
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fec16ee45-7133-4126-b9b8-b205018d3604_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_3.jpg saved to cache
2025-12-05 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item acde8cdf-4f5b-5251-b421-33fff451423c
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc643ac1d0>
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_5.jpg saved to cache
2025-12-05 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 5144487c-74f1-57ec-97c4-bbdafdf8c1c3
2025-12-05 20:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002413019-01994468-002.pdf)
2025-12-05 20:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002599853-01993349-001.pdf)
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64091750>
2025-12-05 20:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fec16ee45-7133-4126-b9b8-b205018d3604_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_5.jpg saved to cache
2025-12-05 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item acde8cdf-4f5b-5251-b421-33fff451423c
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2faa90>
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F394853e7-adb5-4621-8060-e61d2b6a100a_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_5.jpg saved to cache
2025-12-05 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fbf1d10>
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_2.jpg saved to cache
2025-12-05 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5144487c-74f1-57ec-97c4-bbdafdf8c1c3
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2a6250>
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F394853e7-adb5-4621-8060-e61d2b6a100a_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_2.jpg saved to cache
2025-12-05 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc645e5d90>
2025-12-05 20:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fec16ee45-7133-4126-b9b8-b205018d3604_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_2.jpg saved to cache
2025-12-05 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item acde8cdf-4f5b-5251-b421-33fff451423c
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2fb350>
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_2.jpg saved to cache
2025-12-05 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fdab9c25-edd7-5644-9efd-aa77419fa709
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2a4610>
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_5.jpg saved to cache
2025-12-05 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item fdab9c25-edd7-5644-9efd-aa77419fa709
2025-12-05 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002599853-01993349-001.pdf)
2025-12-05 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002636985-01993703-002.pdf)
2025-12-05 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002544324-01988922-003.pdf)
2025-12-05 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002636985-01993703-002.pdf)
2025-12-05 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002413019-01994468-002.pdf)
2025-12-05 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002544324-01988922-003.pdf)
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64403d10>
2025-12-05 20:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F394853e7-adb5-4621-8060-e61d2b6a100a_9.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_9.jpg saved to cache
2025-12-05 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc644d0510>
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F83c40963-edd7-4567-a6a2-f202d7b7e0ad_9.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_9.jpg saved to cache
2025-12-05 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5144487c-74f1-57ec-97c4-bbdafdf8c1c3
2025-12-05 20:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002599853-01993349-001.pdf)
2025-12-05 20:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002636985-01993703-002.pdf)
2025-12-05 20:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002413019-01994468-002.pdf)
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64229910>
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F83c40963-edd7-4567-a6a2-f202d7b7e0ad_10.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_10.jpg saved to cache
2025-12-05 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5144487c-74f1-57ec-97c4-bbdafdf8c1c3
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc643efa10>
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d430913-ce2f-4e1f-bd99-a06d153c601f_9.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_9.jpg saved to cache
2025-12-05 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fdab9c25-edd7-5644-9efd-aa77419fa709
2025-12-05 20:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc642e4550>
2025-12-05 20:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fec16ee45-7133-4126-b9b8-b205018d3604_9.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_9.jpg saved to cache
2025-12-05 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item acde8cdf-4f5b-5251-b421-33fff451423c
2025-12-05 20:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640e0950>
2025-12-05 20:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d430913-ce2f-4e1f-bd99-a06d153c601f_10.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_10.jpg saved to cache
2025-12-05 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fdab9c25-edd7-5644-9efd-aa77419fa709
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64401a10>
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F394853e7-adb5-4621-8060-e61d2b6a100a_10.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_10.jpg saved to cache
2025-12-05 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc641f4d10>
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fec16ee45-7133-4126-b9b8-b205018d3604_10.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_10.jpg saved to cache
2025-12-05 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item acde8cdf-4f5b-5251-b421-33fff451423c
2025-12-05 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002544324-01988922-003.pdf)
2025-12-05 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002544324-01988922-003.pdf)
2025-12-05 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002599853-01993349-001.pdf)
2025-12-05 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002413019-01994468-002.pdf)
2025-12-05 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002636985-01993703-002.pdf)
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6436c550>
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F83c40963-edd7-4567-a6a2-f202d7b7e0ad_11.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_11.jpg saved to cache
2025-12-05 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5144487c-74f1-57ec-97c4-bbdafdf8c1c3
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e52b7d0>
2025-12-05 20:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d430913-ce2f-4e1f-bd99-a06d153c601f_11.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_11.jpg saved to cache
2025-12-05 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fdab9c25-edd7-5644-9efd-aa77419fa709
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2440d0>
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F394853e7-adb5-4621-8060-e61d2b6a100a_11.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_11.jpg saved to cache
2025-12-05 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43
2025-12-05 20:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002599853-01993349-001.pdf)
2025-12-05 20:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002544324-01988922-003.pdf)
2025-12-05 20:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002413019-01994468-002.pdf)
2025-12-05 20:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002636985-01993703-002.pdf)
2025-12-05 20:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002599853-01993349-001.pdf)
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f217210>
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fec16ee45-7133-4126-b9b8-b205018d3604_11.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_11.jpg saved to cache
2025-12-05 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item acde8cdf-4f5b-5251-b421-33fff451423c
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6431d5d0>
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fec16ee45-7133-4126-b9b8-b205018d3604_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_4.jpg saved to cache
2025-12-05 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item acde8cdf-4f5b-5251-b421-33fff451423c
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fbf5850>
2025-12-05 20:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F83c40963-edd7-4567-a6a2-f202d7b7e0ad_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_4.jpg saved to cache
2025-12-05 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5144487c-74f1-57ec-97c4-bbdafdf8c1c3
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fbc2210>
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F394853e7-adb5-4621-8060-e61d2b6a100a_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_4.jpg saved to cache
2025-12-05 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc644d8a90>
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d430913-ce2f-4e1f-bd99-a06d153c601f_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_4.jpg saved to cache
2025-12-05 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fdab9c25-edd7-5644-9efd-aa77419fa709
2025-12-05 20:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002636985-01993703-002.pdf)
2025-12-05 20:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002544324-01988922-003.pdf)
2025-12-05 20:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002599853-01993349-001.pdf)
2025-12-05 20:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002413019-01994468-002.pdf)
2025-12-05 20:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002413019-01994468-002.pdf)
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fbf4090>
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_1.jpg saved to cache
2025-12-05 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5144487c-74f1-57ec-97c4-bbdafdf8c1c3
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fbc0410>
2025-12-05 20:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fec16ee45-7133-4126-b9b8-b205018d3604_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_5.jpg saved to cache
2025-12-05 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item acde8cdf-4f5b-5251-b421-33fff451423c
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640d02d0>
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F394853e7-adb5-4621-8060-e61d2b6a100a_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_5.jpg saved to cache
2025-12-05 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6418d510>
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d430913-ce2f-4e1f-bd99-a06d153c601f_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_5.jpg saved to cache
2025-12-05 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fdab9c25-edd7-5644-9efd-aa77419fa709
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640d2510>
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F83c40963-edd7-4567-a6a2-f202d7b7e0ad_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_5.jpg saved to cache
2025-12-05 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5144487c-74f1-57ec-97c4-bbdafdf8c1c3
2025-12-05 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002544324-01988922-003.pdf)
2025-12-05 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002544324-01988922-003.pdf)
2025-12-05 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002599853-01993349-001.pdf)
2025-12-05 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002599853-01993349-001.pdf)
2025-12-05 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002636985-01993703-002.pdf)
2025-12-05 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002636985-01993703-002.pdf)
2025-12-05 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002413019-01994468-002.pdf)
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc644c5d50>
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_1.jpg saved to cache
2025-12-05 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fdab9c25-edd7-5644-9efd-aa77419fa709
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64164250>
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fec16ee45-7133-4126-b9b8-b205018d3604_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_1.jpg saved to cache
2025-12-05 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item acde8cdf-4f5b-5251-b421-33fff451423c
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc642e6f50>
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_6.jpg saved to cache
2025-12-05 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5144487c-74f1-57ec-97c4-bbdafdf8c1c3
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2ab290>
2025-12-05 20:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F394853e7-adb5-4621-8060-e61d2b6a100a_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_1.jpg saved to cache
2025-12-05 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e533e10>
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F394853e7-adb5-4621-8060-e61d2b6a100a_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_6.jpg saved to cache
2025-12-05 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43
2025-12-05 20:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002413019-01994468-002.pdf)
2025-12-05 20:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002636985-01993703-002.pdf)
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fb94d10>
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fec16ee45-7133-4126-b9b8-b205018d3604_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_7.jpg saved to cache
2025-12-05 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item acde8cdf-4f5b-5251-b421-33fff451423c
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64085150>
2025-12-05 20:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fec16ee45-7133-4126-b9b8-b205018d3604_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_6.jpg saved to cache
2025-12-05 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item acde8cdf-4f5b-5251-b421-33fff451423c
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6408a110>
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_7.jpg saved to cache
2025-12-05 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5144487c-74f1-57ec-97c4-bbdafdf8c1c3
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fb94810>
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_7.jpg saved to cache
2025-12-05 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5144487c-74f1-57ec-97c4-bbdafdf8c1c3
2025-12-05 20:03:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5144487c-74f1-57ec-97c4-bbdafdf8c1c3, skipping ID generation
2025-12-05 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5144487c-74f1-57ec-97c4-bbdafdf8c1c3 from tracking dictionaries
2025-12-05 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5144487c-74f1-57ec-97c4-bbdafdf8c1c3 sending to next pipeline
2025-12-05 20:03:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 5144487c-74f1-57ec-97c4-bbdafdf8c1c3, identifier: 2599853
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64166110>
2025-12-05 20:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_6.jpg saved to cache
2025-12-05 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fdab9c25-edd7-5644-9efd-aa77419fa709
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e536a10>
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_7.jpg saved to cache
2025-12-05 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fdab9c25-edd7-5644-9efd-aa77419fa709
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64306850>
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F394853e7-adb5-4621-8060-e61d2b6a100a_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_7.jpg saved to cache
2025-12-05 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43
2025-12-05 20:03:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 5144487c-74f1-57ec-97c4-bbdafdf8c1c3 with identifier: 2599853
2025-12-05 20:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 5144487c-74f1-57ec-97c4-bbdafdf8c1c3 with identifier: 2599853
2025-12-05 20:03:24 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 5144487c-74f1-57ec-97c4-bbdafdf8c1c3 with identifier: 2599853 to the API
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:03:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:03:25 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_expert_report_file_e50fd7c1-a4e2-4f73-83e9-0d39a57201ce.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002599853-01993349-001.pdf',
'color': 'Black',
'currency': 'GBP',
'engine': '1.5L',
'expiration_date': '2025-12-09T09:00:00Z',
'fuel_type': 'Diesel',
'id': '5144487c-74f1-57ec-97c4-bbdafdf8c1c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MW68CWD',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C4%20GRAND%20SPACETOURER?id=2599853',
'listing': 'auction',
'location': 'Colchester',
'make': 'CITROEN',
'model': 'C4 GRAND SPACETOURER',
'odometer': 62223,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 36,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210659,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210659,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189255,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151720,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 203015,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210689,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210134,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 193985,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 215333,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 247944,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 229529,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214815,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 247814,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/83c40963-edd7-4567-a6a2-f202d7b7e0ad_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 282623,
'Height': 843,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2599853-4010403-13.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331319,
'Height': 843,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2599853-4010403-1000.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 229654,
'Height': 843,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2599853-4010403-1001.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 372119,
'Height': 843,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2599853-4010403-1002.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318804,
'Height': 843,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2599853-4010403-1003.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 234254,
'Height': 843,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2599853-4010403-1004.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5144487c-74f1-57ec-97c4-bbdafdf8c1c3/5144487c-74f1-57ec-97c4-bbdafdf8c1c3_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 274410,
'Height': 843,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2599853-4010403-1005.jpg',
'Width': 1500}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-16',
'seller_name': 'Big Motoring World Ltd',
'title': 'CITROEN C4 GRAND SPACETOURER 1.5 BlueHDi 130 Feel 5dr',
'transmission': 'manual',
'trim': '1.5 BlueHDi 130 Feel 5dr',
'year': 2019}
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272599853%27 HTTP/1.1" 200 None
2025-12-05 20:03:25 [manheim.gb] INFO: Saving data for 2599853: {'created_time': 1764965005.08856, 'last_price_update_time': 1764965005.08857, 'auction_closing_time': 1765270800.0}
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2599853') HTTP/1.1" 204 0
2025-12-05 20:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002544324-01988922-003.pdf)
2025-12-05 20:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e529ed0>
2025-12-05 20:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F394853e7-adb5-4621-8060-e61d2b6a100a_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_7.jpg saved to cache
2025-12-05 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43
2025-12-05 20:03:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43, skipping ID generation
2025-12-05 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43 from tracking dictionaries
2025-12-05 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43 sending to next pipeline
2025-12-05 20:03:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43, identifier: 2413019
2025-12-05 20:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f206d90>
2025-12-05 20:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_7.jpg saved to cache
2025-12-05 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fdab9c25-edd7-5644-9efd-aa77419fa709
2025-12-05 20:03:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fdab9c25-edd7-5644-9efd-aa77419fa709, skipping ID generation
2025-12-05 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fdab9c25-edd7-5644-9efd-aa77419fa709 from tracking dictionaries
2025-12-05 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fdab9c25-edd7-5644-9efd-aa77419fa709 sending to next pipeline
2025-12-05 20:03:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: fdab9c25-edd7-5644-9efd-aa77419fa709, identifier: 2636985
2025-12-05 20:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43 with identifier: 2413019
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 20:03:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BRONZE HTTP/1.1" 200 None
2025-12-05 20:03:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 20:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43 with identifier: 2413019
2025-12-05 20:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 181950 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
181950
2025-12-05 20:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43 spider: manheim.gb
2025-12-05 20:03:26 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 799c80b7-e5c2-5a60-8e1c-c217c3fb1e43 due to rule: high_mileage_for_country.json, error: 181950 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
181950
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_expert_report_file_28af5312-86f1-4524-b3d3-cf32e2a612f9.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002413019-01994468-002.pdf',
'color': 'BRONZE',
'currency': 'GBP',
'engine': '2.0L',
'expiration_date': '2025-12-08T09:00:00Z',
'fuel_type': 'Diesel',
'id': '799c80b7-e5c2-5a60-8e1c-c217c3fb1e43',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AF60ZFP',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/MONDEO?id=2413019',
'listing': 'auction',
'location': 'Leeds',
'make': 'FORD',
'model': 'MONDEO',
'odometer': 113059,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 30,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214802,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214802,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 254633,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 163931,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199783,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196560,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 206802,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196602,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 200301,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261365,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 231735,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 251119,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 278817,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/394853e7-adb5-4621-8060-e61d2b6a100a_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 401927,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2413019-4009542-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275955,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2413019-4009542-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 371353,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2413019-4009542-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 255000,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2413019-4009542-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287271,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2413019-4009542-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324854,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2413019-4009542-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799c80b7-e5c2-5a60-8e1c-c217c3fb1e43/799c80b7-e5c2-5a60-8e1c-c217c3fb1e43_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297979,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2413019-4009542-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-10-12',
'seller_name': 'Big Motoring World Ltd',
'title': 'FORD MONDEO 2.0 TDCi 140 Zetec 5dr',
'transmission': 'manual',
'trim': '2.0 TDCi 140 Zetec 5dr',
'year': 2010}
2025-12-05 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272413019%27 HTTP/1.1" 200 None
2025-12-05 20:03:26 [manheim.gb] INFO: Saving data for 2413019: {'created_time': 1764965006.234971, 'last_price_update_time': 1764965006.234982, 'auction_closing_time': 1765184400.0}
2025-12-05 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2413019') HTTP/1.1" 204 0
2025-12-05 20:03:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: fdab9c25-edd7-5644-9efd-aa77419fa709 with identifier: 2636985
2025-12-05 20:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: fdab9c25-edd7-5644-9efd-aa77419fa709 with identifier: 2636985
2025-12-05 20:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 158191 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
158191
2025-12-05 20:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: fdab9c25-edd7-5644-9efd-aa77419fa709 spider: manheim.gb
2025-12-05 20:03:26 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: fdab9c25-edd7-5644-9efd-aa77419fa709 due to rule: high_mileage_for_country.json, error: 158191 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
158191
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_expert_report_file_54d70be9-74b8-4ceb-8ff7-1dc5334968c8.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002636985-01993703-002.pdf',
'color': 'BLACK',
'currency': 'GBP',
'engine': '1.6L',
'expiration_date': '2025-12-08T09:00:00Z',
'fuel_type': 'Diesel',
'id': 'fdab9c25-edd7-5644-9efd-aa77419fa709',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LO11YHM',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MINI/COUNTRYMAN?id=2636985',
'listing': 'auction',
'location': 'Birmingham',
'make': 'MINI',
'model': 'COUNTRYMAN',
'odometer': 98296,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 31,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 215202,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 215202,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212234,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 175090,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204497,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 209596,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199639,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 208255,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214652,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 227408,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 215926,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199429,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245311,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2d430913-ce2f-4e1f-bd99-a06d153c601f_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292407,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2636985-4009658-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 200627,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2636985-4009658-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 234719,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2636985-4009658-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220205,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2636985-4009658-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 201577,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2636985-4009658-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287079,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2636985-4009658-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdab9c25-edd7-5644-9efd-aa77419fa709/fdab9c25-edd7-5644-9efd-aa77419fa709_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189361,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2636985-4009658-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-07-31',
'seller_name': 'Big Motoring World Ltd',
'title': 'MINI COUNTRYMAN 1.6 Cooper D ALL4 5dr',
'transmission': 'manual',
'trim': '1.6 Cooper D ALL4 5dr',
'year': 2011}
2025-12-05 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272636985%27 HTTP/1.1" 200 None
2025-12-05 20:03:26 [manheim.gb] INFO: Saving data for 2636985: {'created_time': 1764965006.473653, 'last_price_update_time': 1764965006.473662, 'auction_closing_time': 1765184400.0}
2025-12-05 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2636985') HTTP/1.1" 204 0
2025-12-05 20:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc641b8ad0>
2025-12-05 20:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fec16ee45-7133-4126-b9b8-b205018d3604_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_7.jpg saved to cache
2025-12-05 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item acde8cdf-4f5b-5251-b421-33fff451423c
2025-12-05 20:03:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: acde8cdf-4f5b-5251-b421-33fff451423c, skipping ID generation
2025-12-05 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item acde8cdf-4f5b-5251-b421-33fff451423c from tracking dictionaries
2025-12-05 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item acde8cdf-4f5b-5251-b421-33fff451423c sending to next pipeline
2025-12-05 20:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: acde8cdf-4f5b-5251-b421-33fff451423c, identifier: 2544324
2025-12-05 20:03:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: acde8cdf-4f5b-5251-b421-33fff451423c with identifier: 2544324
2025-12-05 20:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: acde8cdf-4f5b-5251-b421-33fff451423c with identifier: 2544324
2025-12-05 20:03:26 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: acde8cdf-4f5b-5251-b421-33fff451423c with identifier: 2544324 to the API
2025-12-05 20:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 20:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 111,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_expert_report_file_1eb72f2c-c27d-46dc-b8bb-ff48f767dce6.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002544324-01988922-003.pdf',
'color': 'GREY',
'currency': 'GBP',
'engine': '1.5L',
'expiration_date': '2025-12-08T09:00:00Z',
'fuel_type': 'Petrol',
'id': 'acde8cdf-4f5b-5251-b421-33fff451423c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DC68JUA',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MAZDA/2?id=2544324',
'listing': 'auction',
'location': 'Leeds',
'make': 'MAZDA',
'model': '2',
'odometer': 71113,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 194351,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 194351,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 235438,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187688,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 148629,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 169288,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172007,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 200235,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217283,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 235701,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 183887,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188854,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199505,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ec16ee45-7133-4126-b9b8-b205018d3604_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296504,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2544324-4009293-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 169142,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2544324-4009293-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317976,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2544324-4009293-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 282511,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2544324-4009293-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327625,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2544324-4009293-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353323,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2544324-4009293-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acde8cdf-4f5b-5251-b421-33fff451423c/acde8cdf-4f5b-5251-b421-33fff451423c_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 276802,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2544324-4009293-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-30',
'seller_name': 'Available Car',
'title': 'MAZDA 2 1.5 GT Sport Nav+ 5dr',
'transmission': 'manual',
'trim': '1.5 GT Sport Nav+ 5dr',
'year': 2018}
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272544324%27 HTTP/1.1" 200 None
2025-12-05 20:03:27 [manheim.gb] INFO: Saving data for 2544324: {'created_time': 1764965007.195515, 'last_price_update_time': 1764965007.195525, 'auction_closing_time': 1765184400.0}
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2544324') HTTP/1.1" 204 0
2025-12-05 20:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002597131-01992846-002.pdf> (referer: None)
2025-12-05 20:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fbbb050>
2025-12-05 20:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_expert_report_file_a6df37b3-f861-4580-a47d-ba73e64df2b8.pdf HTTP/1.1" 201 0
2025-12-05 20:03:27 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6124836e-0bc9-58a0-92f9-719ef4ff9395
2025-12-05 20:03:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6124836e-0bc9-58a0-92f9-719ef4ff9395, skipping ID generation
2025-12-05 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 6124836e-0bc9-58a0-92f9-719ef4ff9395
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_7.jpg not downloaded yet
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_7.jpg not downloaded yet
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_6.jpg not downloaded yet
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_1.jpg not downloaded yet
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F387fc7bd-9b89-4f17-a1ad-3654d27254ef_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_5.jpg not downloaded yet
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F387fc7bd-9b89-4f17-a1ad-3654d27254ef_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_4.jpg not downloaded yet
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F387fc7bd-9b89-4f17-a1ad-3654d27254ef_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_11.jpg not downloaded yet
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F387fc7bd-9b89-4f17-a1ad-3654d27254ef_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_10.jpg not downloaded yet
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F387fc7bd-9b89-4f17-a1ad-3654d27254ef_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_9.jpg not downloaded yet
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_2.jpg not downloaded yet
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_5.jpg not downloaded yet
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_3.jpg not downloaded yet
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_4.jpg not downloaded yet
2025-12-05 20:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002597131-01992846-002.pdf)
2025-12-05 20:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002597131-01992846-002.pdf)
2025-12-05 20:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002597131-01992846-002.pdf)
2025-12-05 20:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002597131-01992846-002.pdf)
2025-12-05 20:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002597131-01992846-002.pdf)
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2597131-4009882-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2597131-4009882-13.jpg not downloaded yet
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2597131-4009882-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2597131-4009882-1000.jpg not downloaded yet
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2597131-4009882-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2597131-4009882-1001.jpg not downloaded yet
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2597131-4009882-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2597131-4009882-1002.jpg not downloaded yet
2025-12-05 20:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002597131-01992846-002.pdf)
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2597131-4009882-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2597131-4009882-1003.jpg not downloaded yet
2025-12-05 20:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002597131-01992846-002.pdf)
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2597131-4009882-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2597131-4009882-1004.jpg not downloaded yet
2025-12-05 20:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002597131-01992846-002.pdf)
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2597131-4009882-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2597131-4009882-1005.jpg not downloaded yet
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc645e4050>
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_0.jpg HTTP/1.1" 201 0
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_7.jpg saved to cache
2025-12-05 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6124836e-0bc9-58a0-92f9-719ef4ff9395
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64186250>
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_1.jpg HTTP/1.1" 201 0
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_7.jpg saved to cache
2025-12-05 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6124836e-0bc9-58a0-92f9-719ef4ff9395
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc640d87d0>
2025-12-05 20:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_2.jpg HTTP/1.1" 201 0
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_6.jpg saved to cache
2025-12-05 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6124836e-0bc9-58a0-92f9-719ef4ff9395
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f2d6c50>
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_5.jpg HTTP/1.1" 201 0
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F387fc7bd-9b89-4f17-a1ad-3654d27254ef_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_4.jpg saved to cache
2025-12-05 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6124836e-0bc9-58a0-92f9-719ef4ff9395
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6408ac10>
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_4.jpg HTTP/1.1" 201 0
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F387fc7bd-9b89-4f17-a1ad-3654d27254ef_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_5.jpg saved to cache
2025-12-05 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6124836e-0bc9-58a0-92f9-719ef4ff9395
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fbca210>
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_3.jpg HTTP/1.1" 201 0
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_1.jpg saved to cache
2025-12-05 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6124836e-0bc9-58a0-92f9-719ef4ff9395
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fbf7150>
2025-12-05 20:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_7.jpg HTTP/1.1" 201 0
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F387fc7bd-9b89-4f17-a1ad-3654d27254ef_10.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_10.jpg saved to cache
2025-12-05 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6124836e-0bc9-58a0-92f9-719ef4ff9395
2025-12-05 20:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002597131-01992846-002.pdf)
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f247f10>
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_6.jpg HTTP/1.1" 201 0
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F387fc7bd-9b89-4f17-a1ad-3654d27254ef_11.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_11.jpg saved to cache
2025-12-05 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6124836e-0bc9-58a0-92f9-719ef4ff9395
2025-12-05 20:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002597131-01992846-002.pdf)
2025-12-05 20:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002597131-01992846-002.pdf)
2025-12-05 20:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002597131-01992846-002.pdf)
2025-12-05 20:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002597131-01992846-002.pdf)
2025-12-05 20:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2597131-4009882-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002597131-01992846-002.pdf)
2025-12-05 20:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2597131-4009882-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002597131-01992846-002.pdf)
2025-12-05 20:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2597131-4009882-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002597131-01992846-002.pdf)
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc644e4a50>
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_8.jpg HTTP/1.1" 201 0
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F387fc7bd-9b89-4f17-a1ad-3654d27254ef_9.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_9.jpg saved to cache
2025-12-05 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6124836e-0bc9-58a0-92f9-719ef4ff9395
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc644c6dd0>
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_9.jpg HTTP/1.1" 201 0
2025-12-05 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_2.jpg saved to cache
2025-12-05 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6124836e-0bc9-58a0-92f9-719ef4ff9395
2025-12-05 20:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e52b0d0>
2025-12-05 20:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 20:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_10.jpg HTTP/1.1" 201 0
2025-12-05 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_5.jpg saved to cache
2025-12-05 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 6124836e-0bc9-58a0-92f9-719ef4ff9395
2025-12-05 20:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6435da50>
2025-12-05 20:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_11.jpg HTTP/1.1" 201 0
2025-12-05 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_3.jpg saved to cache
2025-12-05 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 6124836e-0bc9-58a0-92f9-719ef4ff9395
2025-12-05 20:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5e529f10>
2025-12-05 20:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_12.jpg HTTP/1.1" 201 0
2025-12-05 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_4.jpg saved to cache
2025-12-05 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 6124836e-0bc9-58a0-92f9-719ef4ff9395
2025-12-05 20:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6435c990>
2025-12-05 20:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_14.jpg HTTP/1.1" 201 0
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2597131-4009882-1000.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2597131-4009882-1000.jpg saved to cache
2025-12-05 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 6124836e-0bc9-58a0-92f9-719ef4ff9395
2025-12-05 20:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fba3c50>
2025-12-05 20:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_15.jpg HTTP/1.1" 201 0
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2597131-4009882-1001.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2597131-4009882-1001.jpg saved to cache
2025-12-05 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 6124836e-0bc9-58a0-92f9-719ef4ff9395
2025-12-05 20:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5fba13d0>
2025-12-05 20:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_13.jpg HTTP/1.1" 201 0
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2597131-4009882-13.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2597131-4009882-13.jpg saved to cache
2025-12-05 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 6124836e-0bc9-58a0-92f9-719ef4ff9395
2025-12-05 20:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2597131-4009882-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002597131-01992846-002.pdf)
2025-12-05 20:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2597131-4009882-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002597131-01992846-002.pdf)
2025-12-05 20:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2597131-4009882-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002597131-01992846-002.pdf)
2025-12-05 20:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2597131-4009882-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002597131-01992846-002.pdf)
2025-12-05 20:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f216590>
2025-12-05 20:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_16.jpg HTTP/1.1" 201 0
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2597131-4009882-1002.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2597131-4009882-1002.jpg saved to cache
2025-12-05 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 6124836e-0bc9-58a0-92f9-719ef4ff9395
2025-12-05 20:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc64174190>
2025-12-05 20:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_18.jpg HTTP/1.1" 201 0
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2597131-4009882-1004.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2597131-4009882-1004.jpg saved to cache
2025-12-05 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 6124836e-0bc9-58a0-92f9-719ef4ff9395
2025-12-05 20:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc5f215b90>
2025-12-05 20:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_17.jpg HTTP/1.1" 201 0
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2597131-4009882-1003.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2597131-4009882-1003.jpg saved to cache
2025-12-05 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 6124836e-0bc9-58a0-92f9-719ef4ff9395
2025-12-05 20:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 20:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 20:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 20:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fcc6431c890>
2025-12-05 20:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 20:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_19.jpg HTTP/1.1" 201 0
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2597131-4009882-1005.jpg') HTTP/1.1" 204 0
2025-12-05 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2597131-4009882-1005.jpg saved to cache
2025-12-05 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 6124836e-0bc9-58a0-92f9-719ef4ff9395
2025-12-05 20:03:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6124836e-0bc9-58a0-92f9-719ef4ff9395, skipping ID generation
2025-12-05 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6124836e-0bc9-58a0-92f9-719ef4ff9395 from tracking dictionaries
2025-12-05 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6124836e-0bc9-58a0-92f9-719ef4ff9395 sending to next pipeline
2025-12-05 20:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 6124836e-0bc9-58a0-92f9-719ef4ff9395, identifier: 2597131
2025-12-05 20:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 6124836e-0bc9-58a0-92f9-719ef4ff9395 with identifier: 2597131
2025-12-05 20:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 6124836e-0bc9-58a0-92f9-719ef4ff9395 with identifier: 2597131
2025-12-05 20:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 174875 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
174875
2025-12-05 20:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 6124836e-0bc9-58a0-92f9-719ef4ff9395 spider: manheim.gb
2025-12-05 20:03:34 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 6124836e-0bc9-58a0-92f9-719ef4ff9395 due to rule: high_mileage_for_country.json, error: 174875 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
174875
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_expert_report_file_a6df37b3-f861-4580-a47d-ba73e64df2b8.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002597131-01992846-002.pdf',
'color': 'GREY',
'currency': 'GBP',
'engine': '2.0L',
'expiration_date': '2025-12-09T09:00:00Z',
'fuel_type': 'Petrol',
'id': '6124836e-0bc9-58a0-92f9-719ef4ff9395',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RY66NYR',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/A3?id=2597131',
'listing': 'auction',
'location': 'Northampton',
'make': 'AUDI',
'model': 'A3',
'odometer': 108663,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 30,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 222853,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 222853,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253283,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 251438,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217784,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212686,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 213718,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 213999,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 219988,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318890,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 269657,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 256004,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 244287,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/387fc7bd-9b89-4f17-a1ad-3654d27254ef_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353024,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2597131-4009882-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283415,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2597131-4009882-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 267626,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2597131-4009882-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 262657,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2597131-4009882-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280335,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2597131-4009882-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263395,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2597131-4009882-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6124836e-0bc9-58a0-92f9-719ef4ff9395/6124836e-0bc9-58a0-92f9-719ef4ff9395_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 265822,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2597131-4009882-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-20',
'seller_name': 'Wollaston',
'title': 'AUDI A3 2.0 TFSI S Line 3dr',
'transmission': 'manual',
'trim': '2.0 TFSI S Line 3dr',
'year': 2016}
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272597131%27 HTTP/1.1" 200 None
2025-12-05 20:03:34 [manheim.gb] INFO: Saving data for 2597131: {'created_time': 1764965014.707667, 'last_price_update_time': 1764965014.70768, 'auction_closing_time': 1765270800.0}
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2597131') HTTP/1.1" 204 0
2025-12-05 20:03:34 [scrapy.core.engine] INFO: Closing spider (finished)
2025-12-05 20:03:34 [manheim.gb] INFO: manheim.gb Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 1, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 1, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 6}
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20last_price_update_time%20lt%201764533014 HTTP/1.1" 200 None
2025-12-05 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='manheim.gb',RowKey='1185772') HTTP/1.1" 204 0
2025-12-05 20:03:35 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (10 items) in: file:///var/lib/scrapyd/items/sourcing_v2/manheim.gb/task_37_2025-12-05T20_00_00.jl
2025-12-05 20:03:35 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 532243,
'downloader/request_count': 434,
'downloader/request_method_count/GET': 432,
'downloader/request_method_count/POST': 2,
'downloader/response_bytes': 169290780,
'downloader/response_count': 434,
'downloader/response_status_count/200': 434,
'elapsed_time_seconds': 205.566064,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2025, 12, 5, 20, 3, 34, 977979, tzinfo=datetime.timezone.utc),
'item_dropped_count': 22,
'item_dropped_reasons_count/DropItem': 22,
'item_scraped_count': 10,
'log_count/DEBUG': 4641,
'log_count/ERROR': 8,
'log_count/INFO': 4194,
'memusage/max': 198971392,
'memusage/startup': 127160320,
'photo_download_count': 380,
'playwright/context_count': 1,
'playwright/context_count/max_concurrent': 1,
'playwright/context_count/persistent/False': 1,
'playwright/context_count/remote/False': 1,
'playwright/page_count': 1,
'playwright/page_count/max_concurrent': 1,
'playwright/request_count': 84,
'playwright/request_count/aborted': 46,
'playwright/request_count/method/GET': 81,
'playwright/request_count/method/POST': 3,
'playwright/request_count/navigation': 4,
'playwright/request_count/resource_type/document': 4,
'playwright/request_count/resource_type/font': 8,
'playwright/request_count/resource_type/image': 40,
'playwright/request_count/resource_type/script': 22,
'playwright/request_count/resource_type/stylesheet': 8,
'playwright/request_count/resource_type/xhr': 2,
'playwright/response_count': 38,
'playwright/response_count/method/GET': 35,
'playwright/response_count/method/POST': 3,
'playwright/response_count/resource_type/document': 4,
'playwright/response_count/resource_type/font': 8,
'playwright/response_count/resource_type/script': 16,
'playwright/response_count/resource_type/stylesheet': 8,
'playwright/response_count/resource_type/xhr': 2,
'request_depth_max': 5,
'response_received_count': 54,
'scheduler/dequeued': 434,
'scheduler/dequeued/memory': 434,
'scheduler/enqueued': 434,
'scheduler/enqueued/memory': 434,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 34,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 28.996027881649376,
'scrapy-zyte-api/mean_response_seconds': 29.17834167756647,
'scrapy-zyte-api/processed': 34,
'scrapy-zyte-api/request_args/actions': 32,
'scrapy-zyte-api/request_args/browserHtml': 32,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 2,
'scrapy-zyte-api/request_args/experimental.requestCookies': 34,
'scrapy-zyte-api/request_args/experimental.responseCookies': 34,
'scrapy-zyte-api/request_args/httpRequestBody': 2,
'scrapy-zyte-api/request_args/httpRequestMethod': 2,
'scrapy-zyte-api/request_args/httpResponseBody': 2,
'scrapy-zyte-api/request_args/httpResponseHeaders': 2,
'scrapy-zyte-api/request_args/requestHeaders': 32,
'scrapy-zyte-api/request_args/sessionContext': 32,
'scrapy-zyte-api/request_args/url': 34,
'scrapy-zyte-api/status_codes/200': 34,
'scrapy-zyte-api/success': 34,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'spider_exceptions/ValueError': 1,
'start_time': datetime.datetime(2025, 12, 5, 20, 0, 9, 411915, tzinfo=datetime.timezone.utc)}
2025-12-05 20:03:35 [scrapy.core.engine] INFO: Spider closed (finished)